Display device and operating method thereof

ABSTRACT

Provided is a display device including: a display, a communication interface comprising communication circuitry configured to communicate with a source device, and a processor configured to execute at least one instruction. When an aspect ratio of an image corresponding to content is changed, the display device may output an optimized full screen in response to the change of the aspect ratio.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of International Application No.PCT/KR2022/013196 designating the United States, filed on Sep. 2, 2022,in the Korean Intellectual Property Receiving Office and claimingpriority to Korean Patent Application No. 10-2021-0117197, filed on Sep.2, 2021, in the Korean Intellectual Property Office, the disclosures ofwhich are incorporated by reference herein in their entireties.

BACKGROUND Field

The disclosure relates to a display device capable of reproducingcontent and an operating method thereof.

For example, the disclosure relates to a display device capable ofsupporting output of images having various aspect ratios to reproducecontent (e.g., game content) in a wide screen mode and an operatingmethod thereof.

Description of Related Art

Due to the development of display device technologies, display devicescapable of implementing various functions have been developed.

Televisions (TVs) are a representative example of the display devices.Existing TVs merely receive broadcast signals and reproduce broadcastcontent corresponding thereto (e.g., news, dramas, and music programs).

Currently, due to the development of display device technologies,various applications or programs for performing various functions may bestored and installed on the TVs, and various functions and servicesother than the broadcast content reproduction function may also beprovided using the installed applications. For example, a gameapplication may be stored and installed on a TV, and game content may beexecuted using the game application.

In addition, due to the development of communication technologies andcommunication connection functions of display devices, display deviceshave been developed to provide various functions or services throughwired or wireless communication with external devices. For example, adisplay device may be connected to an external device (e.g., a sourcedevice or a game console) through wired or wireless communication, andreceive content (e.g., game content) from the external device (e.g., thegame console) through the wired or wireless communication.

A method and apparatus capable of outputting a reproduction screen ofgame content so as to increase user satisfaction when the game contentis provided through a display device is required.

For example, a method and apparatus capable of increasing usersatisfaction in using content by flexibly changing and outputting a fullscreen when an aspect ratio of game content reproduced on a displaydevice capable of supporting output in various aspect ratios is changedare required.

SUMMARY

Embodiments of the disclosure provide a display device capable ofoutputting an optimized full screen in response to a change of an aspectratio of an image corresponding to content, and an operating methodthereof.

Embodiments of the disclosure provide a display device capable ofreproducing game content and of outputting an optimized full screen inresponse to a change of an aspect ratio of an image of received gamecontent (e.g., a game image), and an operating method thereof.

Embodiments of the disclosure provide a display device capable ofoutputting an optimized full screen by flexibly changing enlargement ofa partial area set in a game image, in response to a change of an aspectratio of the game image after the game image is displayed, and anoperating method thereof.

According to an example embodiment of the disclosure, a display deviceincludes: a display, a communication interface comprising communicationcircuitry configured to communicate with a source device, and aprocessor configured to execute at least one instruction. The processormay be further configured to execute the at least one instruction tocontrol the display device to: receive, from the source device, a firstimage corresponding to a first aspect ratio based on a first partialarea being identified in the first image, display a first full screenincluding the first image and a first enlarged image corresponding tothe first partial area based on a second image corresponding to a secondaspect ratio different from the first aspect ratio being received fromthe source device, identify, in the second image, a second partial areacorresponding to the first partial area based on the first and secondaspect ratios, and display a second full screen including the secondimage and a second enlarged image corresponding to the identified secondpartial area.

The processor may be further configured to execute the at least oneinstruction to: identify, in the second image, the second partial areaincluding the same image object as an image object included in the firstpartial area in the first image, based on the first and second aspectratios, and obtain the second enlarged image corresponding to theidentified second partial area.

The processor may be further configured to execute the at least oneinstruction to: control the communication interface to receive thesecond image having the second aspect ratio from the source device,based on an input received while the first image is being received fromthe source device.

The processor may be further configured to execute the at least oneinstruction to: identify, as the first partial area, an area includingat least one of a moving object, a minimap, an item window, a characterwindow, a chat window, or a current status information window, in thefirst image, and obtain the first enlarged image corresponding to thefirst partial area.

The processor may be further configured to execute the at least oneinstruction to: identify the first partial area, based on an input forselecting a partial area in the first image.

The display device may further include a user interface configured to:receive an input, The processor may be further configured to execute theat least one instruction to: control the display device to display auser interface screen for displaying one or more guidance areas on thefirst image, and identify the first partial area, based on an input forselecting at least one of the one or more guidance areas.

The processor may be further configured to execute the at least oneinstruction to: recognize one or more image objects corresponding to oneor more of a minimap, a moving object, an item window, a characterwindow, a chat window, and a current status information window in thefirst image, control the display to display a user interface screen forselecting at least one of the recognized one or more image objects, andidentify the first partial area, based on an input for selecting atleast one of the one or more image objects.

The processor may be further configured to execute the at least oneinstruction to: based on an aspect ratio of the display being the sameas the second aspect ratio, split a full screen of the display into twopartial screens, and control the display to display the second image inone partial screen and display the second enlarged image in the otherpartial screen.

The processor may be further configured to execute the at least oneinstruction to: based on an aspect ratio of the display being differentfrom the second aspect ratio, control the display to display the secondenlarged image on at least a part of a remaining area other than an areawhere the second image is displayed on a full screen of the display.

The processor may be further configured to execute the at least oneinstruction to: adjust a size the second enlarged image to increasescreen use efficiency of the remaining area, and control the display todisplay the size-adjusted second enlarged image on the remaining area.

The processor may be further configured to execute the at least oneinstruction to: adjust at least one of a size or a position of thesecond enlarged image included in the second full screen, based on thesecond aspect ratio and a full screen aspect ratio of the display.

The first image may include an image corresponding to game contentcorresponding to the first aspect ratio. The second image may include animage corresponding to game content corresponding to the second aspectratio.

The processor may be further configured to execute the at least oneinstruction to: identify, as the first partial area, an area including aminimap in the first image corresponding to a reproduction image of gamecontent, generate a first enlarged image corresponding to the firstpartial area, and control the display to display the first full screenincluding the first enlarged image and the first image.

According to an example embodiment of the disclosure, a method ofoperating a display device includes: receiving, from a source device, afirst image corresponding to a first aspect ratio based on a firstpartial area being identified in the first image, displaying a firstfull screen including the first image and a first enlarged imagecorresponding to the first partial area, receiving, from the sourcedevice, a second image corresponding to a second aspect ratio differentfrom the first aspect ratio, identifying, in the second image, a secondpartial area corresponding to the first partial area based on the firstand second aspect ratios, and displaying a second full screen includingthe second image and a second enlarged image corresponding to theidentified second partial area.

The identifying of the second partial area may include identifying, inthe second image, the second partial area including the same imageobject as an image object included in the first partial area in thefirst image, based on the first and second aspect ratios, and obtainingthe second enlarged image corresponding to the identified second partialarea.

The displaying of the first full screen may include identifying, as thefirst partial area, an area where at least one of a moving object, aminimap, an item window, a character window, a chat window, or a currentstatus information window, in the first image, and obtaining the firstenlarged image corresponding to the first partial area.

The method may further include displaying a user interface screen fordisplaying one or more guidance areas on the first image, andidentifying the first partial area, based on an input for selecting atleast one of the one or more guidance areas.

The method may further include recognizing one or more image objectscorresponding to one or more of a minimap, a moving object, an itemwindow, a character window, a chat window, and a current statusinformation window in the first image, displaying a user interfacescreen for selecting at least one of the recognized one or more imageobjects, and identifying the first partial area, based on an input forselecting at least one of the one or more image objects.

The displaying of the second full screen may include, based on an aspectratio of the display being different from the second aspect ratio,displaying the second enlarged image on at least a part of a remainingarea other than an area where the second image is displayed on a fullscreen of a display in the display device.

The displaying of the second full screen may further include adjustingat least one of a size or a position of the second enlarged imageincluded in the second full screen, based on the second aspect ratio anda full screen aspect ratio of a display in the display device.

Using a display device and an operating method thereof, according tovarious example embodiments of the disclosure, when an aspect ratio of agame image corresponding to game content is changed, an optimized fullscreen may be output in response to the change of the aspect ratio,thereby minimizing/reducing inconvenience of a game user and increasingsatisfaction of the game user.

For example, using a display device and an operating method thereof,according to various example embodiments of the disclosure, when anaspect ratio of a game image set with a partial area to be enlarged ischanged after the game image is displayed, enlargement of the partialarea may be automatically changed based on the changed aspect ratio,thereby preventing/reducing an enlarged image display error caused bythe change of the aspect ratio of the game image. As such, according toan example embodiment of the disclosure, satisfaction of a game user maybe increased.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing detailed description, taken in conjunction with theaccompanying drawings, in which:

FIG. 1 is a diagram illustrating a display device for receiving contentfrom a source device according to various embodiments;

FIG. 2 is a diagram a display device capable of supporting output invarious aspect ratios according to various embodiments;

FIG. 3 is describing diagram illustrating a display device capable ofsupporting output in various aspect ratios according to variousembodiments;

FIG. 4 is a diagram illustrating a full screen including a game imageoutput on a display device and having an aspect ratio of 21:9 accordingto various embodiments;

FIG. 5 is a diagram illustrating a change of a full screen based on achange of an aspect ratio of a game image from 21:9 to 32:9 according tovarious embodiments;

FIG. 6 is a diagram illustrating a full screen including a game imageoutput on a display device and having an aspect ratio of 32:9 accordingto various embodiments;

FIG. 7 is a diagram illustrating a change of a full screen based on achange of an aspect ratio of a game image from 32:9 to 21:9 according tovarious embodiments;

FIG. 8 is a block diagram illustrating an example configuration of adisplay device according to various embodiments;

FIG. 9 is a block diagram illustrating an example configuration of adisplay device according to various embodiments;

FIG. 10 is a signal flow diagram illustrating example operationsperformed in a display device, according to various embodiments;

FIG. 11A is a flowchart illustrating an example method of operating adisplay device, according to various embodiments;

FIG. 11B is a flowchart illustrating an example method of operating adisplay device, according to various embodiments;

FIG. 12 is a diagram illustrating an example operation of changing anaspect ratio, according to various embodiments;

FIG. 13 is a diagram illustrating an example operation of switching afull screen output on a display device, according to variousembodiments;

FIG. 14 is a diagram illustrating an example of a user interface screendisplayed on a display device, according to various embodiments;

FIG. 15 is a diagram illustrating an example of a full screen displayedon a display device, according to various embodiments;

FIG. 16 is a diagram illustrating an example of a full screen displayedon a display device, according to various embodiments;

FIG. 17 is a flowchart illustrating an example method of operating adisplay device, according to various embodiments;

FIG. 18 is a diagram illustrating an example game image according tovarious embodiments;

FIG. 19 is a diagram illustrating an example operation of identifying apartial area included in a game image according to various embodiments;

FIG. 20 is a diagram illustrating an example of a full screen outputaccording to various embodiments;

FIG. 21 is a flowchart illustrating an example method of operating adisplay device, according to various embodiments;

FIG. 22 is diagram illustrating an example operation of identifying apartial area included in a game image according to various embodiments;

FIG. 23 is diagram illustrating an example operation of identifying apartial area included in a game image according to various embodiments;

FIG. 24 is a diagram illustrating an example of a full screen includinga game image and an enlarged image according to various embodiments; and

FIG. 25 is a flowchart illustrating an example method of operating adisplay device, according to various embodiments.

DETAILED DESCRIPTION

Hereinafter, the disclosure will be described in greater detail byexplaining various example embodiments of the disclosure with referenceto the attached drawings. The disclosure may, however, be embodied inmany different forms and should not be construed as being limited to theexample embodiments of the disclosure set forth herein. In the drawings,parts not related to the disclosure may not be illustrated for clarityof explanation, and like elements are denoted by like reference numeralsthroughout. In addition, throughout the drawings, the same elements aredenoted by the same reference numerals.

Throughout the disclosure, when an element is referred to as being“connected to” another element, the element can be “directly connectedto” the other element or be “electrically connected to” the otherelement via an intervening element. The terms “comprises”, “comprising”,“includes” and/or “including”, when used herein, specify the presence ofstated elements, but do not preclude the presence or addition of one ormore other elements.

The phrase “an embodiment of the disclosure” at various parts of thisdisclosure does not always designate the same embodiment of thedisclosure.

An embodiment of the disclosure may be represented as functional blocksand various processing steps. Some or all of the functional blocks maybe implemented by various numbers of hardware and/or software elementsconfigured to perform certain functions. For example, the functionalblocks of the disclosure may be implemented by one or more processors ormicroprocessors or implemented by circuit elements configured to performintended functions. As another example, the functional blocks of thedisclosure may be implemented using various programming or scriptinglanguages. The functional blocks may be implemented using algorithmsexecuted by one or more processors. Furthermore, the disclosure mightemploy known technologies for electronic settings, signal processing,and/or data processing. Terms such as “module” and “element” may bewidely used and are not limited to mechanical and physical elements.

In addition, connection lines or connection members between elementsshown in the drawings merely illustrate examples of functionalconnections and/or physical or circuit connections. Connections betweenelements may be represented by replaceable or additional variousfunctional connections, physical connections, or circuit connections inan actual device.

The expression “at least one of A, B, or C” indicates only A, only B,only C, both A and B, both A and C, both B and C, all of A, B, and C, orvariations thereof.

In an embodiment of the disclosure, a display device may refer to anyelectronic device capable of receiving content from a source device andof displaying a screen corresponding thereto. Herein, the content mayinclude, for example, game content, lecture content, cinema content, orhome training service content.

For example, the display device according to an embodiment of thedisclosure may refer, for example, to any electronic device capable ofselectively displaying at least one type of content, and may be providedin various forms, e.g., a television (TV), a smart TV, a digitalbroadcast receiver, a tablet PC, a smartphone, a mobile phone, acomputer, a laptop computer, or the like. The display device may have astationary form, a mobile form, or a form portable by a user.

FIG. 1 is a diagram illustrating an example display device for receivingcontent from a source device according to various embodiments.

Referring to FIG. 1 , a display device 100 may be connected to a sourcedevice 101 through a wired or wireless communication network.

The source device 101 may provide content such as video/audio content tothe display device 100. The source device 101 may be a video gameconsole. As another example, the source device 101 may include varioustypes of electronic devices capable of providing content to the displaydevice 100, e.g., a video game console, a set-top box, a digitalversatile disc (DVD) player, a Blu-ray disc player, a personal computer(PC), and a game machine. The source device 101 may be referred to as asource device in terms of providing content, and also be referred to asa host device, a content providing device, an electronic device, astorage device, a computing device, a server device, a server, or thelike.

The display device 100 may output or display the content received fromthe source device 101. The display device 100 may include various typesof electronic devices capable of receiving and outputting content, e.g.,a network TV, a smart TV, an Internet TV, a web TV, an Internet ProtocolTV (IPTV), and a PC. The display device 100 may be referred to as adisplay device in terms of receiving and displaying content, and also bereferred to as a content receiving device, a sink device, an electronicdevice, a computing device, or the like.

The source device 101 and the display device 100 may be connectedthrough wired connection means for forming a wired network, to performdata transmission or reception therebetween. For example, the wiredconnection means may include a cable, and each of the source device 101and the display device 100 may include one or more ports for cableconnection. The one or more ports may include, for example, ahigh-definition multimedia interface (HDMI) port, a display port, and adigital input interface such as a type-C port.

The source device 101 and the display device 100 may be connectedthrough wireless connection means for forming a wireless network, toperform data transmission or reception therebetween. For example, thewireless connection means may include a wireless HDMI communicationmodule, and each of the source device 101 and the display device 100 mayinclude the wireless HDMI communication module. As another example, thewireless connection means may include at least one communication module(not shown) for performing communication according to a communicationstandard such as Bluetooth, Wi-Fi, Bluetooth low energy (BLE),near-field communication (NFC)/radio frequency identification (RFID),Wi-Fi direct, ultra-wideband (UWB), Zigbee, Internet, 3^(rd) generation(3G), 4th generation (4G), 5th generation (5G), and/or 6th generation(6G).

In FIG. 1 , a case in which the source device 101 and the display device100 are connected through an HDMI cable 105 for performing wired HDMIcommunication is shown as a non-limiting example.

For example, each of the source device 101 and the display device 100may include an HDMI port, and perform communication through the HDMIcable 105 connected to the HDMI port. To provide content to the displaydevice 100, the source device 101 may initially receive extended displayidentification data (EDID) provided by the display device 100, generatecontent in a format corresponding to the received EDID, and provide thegenerated content to the display device 100.

The EDID may refer, for example, to data or information that definesdisplay performance or capability of the display device 100 indisplaying content. For example, the EDID may include at least one ofmanufacturer information, product information, EDID version information,timing information, screen size information, brightness information, orpixel information of the display device 100. Herein, the screen sizeinformation may include information about at least one of a resolutionor an aspect ratio providable by the display device 100.

The source device 101 may obtain the EDID provided by the display device100, generate content to be provided to the display device 100, in aformat based on the obtained EDID, and provide the generated content tothe display device 100. For example, when an aspect ratio identifiedbased on the obtained EDID (specifically, a value of the identifiedaspect ratio) is 32:9, the source device 101 may generate an imagehaving the identified aspect ratio of 32:9, and transmit the generatedimage to the display device 100. That is, the source device 101 havingreceived the EDID from the display device 100 may provide the displaydevice 100 with content in a format suitable for the display performanceof the display device 100. Herein, the image is an image correspondingto the content, and may include a reproduction screen of the content, amenu screen of the content, or the like.

Although it is described that ‘the image is transmitted’ for conveniencein explaining an embodiment of the disclosure, it may refer, forexample, to an image signal corresponding to the image, a packet orstream including the image signal, or audio/video (AV) data includingthe image signal being transmitted.

In the following description, images displayed on a display devicecapable of supporting output in various aspect ratios are described ingreater detail below with reference to FIGS. 2 and 3 .

FIG. 2 is a diagram illustrating an example display device capable ofsupporting output in various aspect ratios according to variousembodiments.

The display device 100 according to an embodiment of the disclosure maysupport output of screens having a plurality of aspect ratios. Herein,the aspect ratio refers to a ratio of a horizontal length to a verticallength of a screen, and may be represented by a value such as 4:3, 16:9,16:10, 21:9, or 32:9. Because the aspect ratio indicates a ratio of awidth to a height of an output screen or image, it may also be referredto as a ‘screen ratio’ or an ‘image ratio’. The aspect ratio of a screenmay be optimized based on the type of an input image.

For example, an aspect ratio capable of increasing user satisfaction maybe selected based on the type of an image output through the screen.

For example, an aspect ratio of 16:9 is the most commonly used screenratio, and may be used to output menu screens or computer screens. Asanother example, an aspect ratio of 21:9 may be used to be provided withmore information in a horizontal direction (or widthwise direction),e.g., cinema screens or game screens. As another example, an aspectratio of 32:9 may be used to output an image for providing or beingprovided with a wide field of view (FoV). For example, the aspect ratioof 32:9 may be used a lot for games provided using a 360° image or apanorama image to increase user satisfaction, e.g., sports games, racinggames, or battle games.

When an image of the same game content is displayed, a different angleof view (AoV) may be provided depending on an aspect ratio of the image.For example, when the aspect ratio of the image is increased in ahorizontal direction, a wider FoV or AoV may be provided. For example, awide FoV or AoV may be provided in the order of the aspect ratio of32:9, the aspect ratio of 21:9, and the aspect ratio of 16:9.

Referring to FIG. 2 , an image 210 having an aspect ratio of 32:9, animage 230 having an aspect ratio of 21:9, and an image 250 having anaspect ratio of 16:9 are shown.

For example, a wide AoV may be provided in the order of the image 210having an aspect ratio of 32:9, the image 230 having an aspect ratio of21:9, and the image 250 having an aspect ratio of 16:9.

Referring to FIG. 2 , the image 210 having an aspect ratio of 32:9 mayprovide the widest AoV. Compared to the image 210 having an aspect ratioof 32:9, the image 230 having an aspect ratio of 21:9 may not provide aFoV for an area to the left of line 201 and an area to the right of line202, but provide a FoV for an area 231 between lines 201 and 202.Compared to the image 210 having an aspect ratio of 32:9, the image 250having an aspect ratio of 16:9 may not provide a FoV for an area to theleft of line 203 and an area to the right of line 204, but provide a FoVfor an area 251 between lines 203 and 204.

As described above, the image 210 having an aspect ratio of 32:9 mayhave a wider AoV compared to the image 230 having an aspect ratio of21:9 or the image 250 having an aspect ratio of 16:9 and thus providemore information to a user who is provided with the game content. Forexample, when a certain area based on a position of the user in a 360°image or a panorama image is displayed as an image of the game content,the image 210 having an aspect ratio of 32:9 may provide the widest AoVfrom among the images 210, 230, and 250 shown in FIG. 2 . As such, theuser who uses the game content may play the game more realistically andimmersively while viewing the widest-AoV image.

In general game content, a game user who has a wider FoV during the gamemay be provided with more information from a provided image, and thus beadvantageous to win the game. Therefore, most game users want to beprovided with a game content image having an even slightly wider AoV.Herein, the game user may include not only a user who plays the game butalso a user who watches the game.

Therefore, when the game content is reproduced, the display device 100capable of supporting output of images corresponding to a plurality ofaspect ratios may display the image in an aspect ratio which is thewidest in a horizontal direction from among the plurality of aspectratios (e.g., an aspect ratio of 32:9 from among aspect ratios of 32:9,21:9, and 16:9).

FIG. 3 is diagram illustrating an example display device capable ofsupporting output in various aspect ratios according to variousembodiments.

FIG. 3 shows, as an example, screens output on the display device 100when a radio of a horizontal length to a vertical length of a display(or display panel) included in the display device 100 is 16:9. That is,‘16:9’ may be a physical aspect ratio of the display device 100 or afull screen aspect ratio of the display device 100.

For example, assuming three-dimensional (3D) game content, the sourcedevice 101 may store a 360° image 210 corresponding to the game content.In FIG. 3 , a case in which the 360° image 210 is the same as the imageshown in FIG. 2 and having an aspect ratio of 32:9 is shown as anexample. The source device 101 may transmit, to the display device 100,an image corresponding to a current FoV and having an aspect ratioidentified based on EDID of the display device 100.

For example, when the aspect ratio identified based on the EDID of thedisplay device 100 is 16:9, the source device 101 may transmit, to thedisplay device 100, an image 340 having an aspect ratio of 16:9. Whenthe image is transmitted, it may refer, for example, to image datacorresponding to the image being transmitted. The display device 100 mayoutput a full screen 370 corresponding to the received image 340.Because the aspect ratio of the received image 340 and the physicalaspect ratio of a display included in the display device 100 are equally16:9, the full screen 370 may display the image 340 without a blackarea.

As another example, when the aspect ratio identified based on the EDIDof the display device 100 is 21:9, the source device 101 may transmit,to the display device 100, an image 330 having an aspect ratio of 21:9.Then, the display device 100 may output a full screen 350 correspondingto the received image 330. Because the aspect ratio of the receivedimage 330 is different from the physical aspect ratio of the displayincluded in the display device 100, the full screen 350 may display theimage 330 together with a black area.

As another example, when the aspect ratio identified based on the EDIDof the display device 100 is 32:9, the source device 101 may transmit,to the display device 100, an image 320 having an aspect ratio of 32:9.The display device 100 may output a full screen 360 corresponding to thereceived image 320. Because the aspect ratio of the received image 320is different from the physical aspect ratio of the display included inthe display device 100, the full screen 360 may display the image 320together with a wider black area compared to the full screen 350.

As described above in relation to FIGS. 1, 2 and 3 (which may bereferred to as FIGS. 1 to 3 ), a display device according to anembodiment of the disclosure may support output of images having variousaspect ratios. Embodiments of the disclosure relate to a method andapparatus capable of minimizing/reducing output screen errors and/oruser inconvenience caused when an aspect ratio of an image is changed ina display device capable of supporting output of images having differentaspect ratios, and a description thereof is now provided in greaterdetail below with reference to FIGS. 4 to 25 . In FIGS. 4 to 25 ,examples in which a radio of a horizontal length to a vertical length ofa display (or display panel) included in a display device according tovarious example embodiments of the disclosure is 16:9 as described abovein relation to FIG. 3 is shown as an example.

FIG. 4 is a diagram illustrating an example full screen including a gameimage output on a display device and having an aspect ratio of 21:9according to various embodiments. For example, FIG. 4 shows an exampleof an image 410 received by the display device, and a full screen 450corresponding thereto. For example, images and full screens shown inFIGS. 4 to 7 are assumed as being received by and output on the displaydevice 100 described above in relation to FIG. 1 . For example, theimages (e.g., game images) shown in FIGS. 4 to 7 are assumed as beinggenerated by the source device 101 described above in relation to FIG. 1, and being transmitted to the display device 100.

Referring to FIG. 4 , the display device 100 may receive game contentfrom the source device 101. For example, the game content may bereceived in the form of a stream or packet including audio and/or videodata. The stream or packet corresponding to the game content may includea plurality of images. Herein, the image may be an image to be displayedto reproduce the game content, e.g., a reproduction screen or a menuscreen of the game content. For example, the image may have a form of animage frame, a frame, or a group of pictures (GOP).

In FIG. 4 and the following drawings referenced below, an example inwhich an image received by a display device according to an embodimentof the disclosure is an image corresponding to game content (hereinafterreferred to as a ‘game image’) is shown and described by way ofnon-limiting example.

The game content provided by the source device 101 may be 3D gamecontent. The 3D game refers to a game which may be played by a user in a3D space (e.g., a virtual space capable of implementing athree-dimensional environment). For example, the user who plays the 3Dgame may play, race, battle, fight, or war against virtual characters ata certain site in the 3D space. As another example, in addition to the3D game content for playing the game in the 3D space, the game contentmay also include 2D game content for playing a general game in atwo-dimensional (2D) space.

In the above-described 3D game or general game, the game image mayinclude at least one sub-window. For example, the sub-window may bedisplayed in a partial area on a game reproduction screen, and include aminimap, a skill window, an item window, a character window, a chatwindow, or a control window to provide information related to theprogress of the game or a service for game participants (e.g., a chatservice). The type of the sub-window included in the game image may varydepending on the type of the game.

For example, the minimap may be an image for displaying a small-scalemap of the space where the game is played. The skill window may be astatus window indicating a skill and a cool-down time of the skill. Theitem window may be a window for providing information about items usedfor the game. For example, the item window may include an item inventorywindow. The item inventory window may display types and/or reuse timesof items owned by the user. The character window may be a window forproviding information about a character used to play the game. Forexample, the character window may include a character status window. Ina game played between allies and enemies, e.g., a battle game, thecharacter status window may be a window indicating health points (HP)and/or mana point (MPs), respawn times, etc. of the allies and/or theenemies. The chat window may be a window for displaying a chat between aplurality of users who play or watch the game. Alternatively, the chatwindow may be a window for displaying a message related to the game.

For example, in a game in which the user controls or drives an objectused for the game (e.g., an aircraft or an automobile), the controlwindow may be a window for providing information related to a cockpit.For example, the control window may include a flight simulation cockpitwindow for providing information required or used for flight oroperation. The flight simulation cockpit window may display an airspeed,an engine condition, fuel, flaps, trims, an altitude, etc.

The above-described sub-window may be separately defined and/ordisplayed on the game image. Instead of being separately defined, thesub-window may be opaquely or translucently displayed on a partial areaof the game image.

Referring to the example of FIG. 4 , a minimap 401 and an item window402 may be displayed on a game image 410 having an aspect ratio of 21:9.In the example of FIG. 4 , two sub-windows such as the minimap 401 andthe item window 402 are displayed in the game image 410.

For example, a partial area included in the game image 410 and to beenlarged may include the above-described sub-window. As another example,the partial area included in the game image 410 and to be enlargedseparately from the game image 410 may include an area where a movingobject is displayed in the game image 410.

For example, to enlarge the sub-window included in the game image 410(e.g., the minimap 401 or the item window 402), the display device 100may display a full screen including the game image 410 and an enlargedimage corresponding to the sub-window.

For example, the sub-window may provide information useful to the userwho plays the game. For example, the game user may view the providedminimap and move an object corresponding to the game user to a positionthat is advantageous to win the game.

The sub-window (e.g., a chat window) may support the exchange ofopinions or information between users who play or watch the game. Assuch, convenience of the game user may be increased.

The sub-window may provide information about the progress of the gameand the victory/defeat or a winning rate of the game.

The sub-window may provide an additional service related to the game.For example, the sub-window may provide a separate service related tothe game (e.g., a link to a shopping mall related to the game or a linkto a broadcast program related to the game).

As described above, the sub-window may provide information useful orhelpful to the game user, and increase convenience of the game user.Therefore, when the sub-window is enlarged compared to that displayed inthe game image, user convenience may be further increased. As such, inan embodiment of the disclosure, a full screen output on the displaydevice 100 may include an enlarged image corresponding to the sub-windowseparately from the game image, and a detailed description thereof isprovided with reference to FIG. 4 .

Referring to the example of FIG. 4 , when a physical aspect ratio of adisplay of the display device 100 is 16:9 as in FIG. 3 , the full screen450 has an aspect ratio of 16:9. When the game image 410 having anaspect ratio of 21:9 is displayed on the full screen 450, a black area460 may occur. The display device 100 may display an enlarged imagecorresponding to the sub-window, on an area other than the area wherethe game image 410 is displayed on the full screen 450, e.g., the blackarea 460. For example, the enlarged image may be an image displayed byenlarging a partial area included in the game image 410 (e.g., an areadisplayed as the sub-window). Alternatively, the enlarged image may bean image displayed by enlarging at least one image object included in apartial area included in the game image 410 (e.g., an area displayed asthe sub-window).

For example, the full screen 450 may include the game image 410 havingan aspect ratio of 21:9, an enlarged image 470 corresponding to theminimap 401 included as a sub-window in the game image 410, and anenlarged image 480 corresponding to the item window 402 included asanother sub-window in the game image 410. Herein, the enlarged images470 and 480 may be displayed on the black area 460.

After the full screen 450 is displayed, the game image 410 may bereceived in a changed aspect ratio. Because the display device 100supports output in a plurality of aspect ratios, the display device 100may receive the image having the changed aspect ratio, decode thereceived image, and display a full screen corresponding to the decodedimage.

In this example, an enlarged image display error may occur. The enlargedimage display error is now described in greater detail below withreference to FIG. 5 .

FIG. 5 is a diagram illustrating an example change of a full screenbased on a change of an aspect ratio of a game image from 21:9 to 32:9according to various embodiments. In FIG. 5 , the same configurations asthose of FIG. 4 are denoted by the same reference numerals. Thus, arepeated description thereof may not be provided herein.

Referring to FIG. 5 , after the game image 410 having an aspect ratio of21:9 is received, the aspect ratio of the game image 410 may be changedto 32:9 and a game image 501 having the changed aspect ratio may bereceived. The display device 100 may display a full screen 510 includingthe game image 501 having the changed aspect ratio of 32:9.

When an aspect ratio of an image corresponding to reproduced content ischanged as described above, an existing or general display device doesnot change the position and size of a sub-window set in the imagereceived before the aspect ratio is changed. As such, a partial areacorresponding to the position and size of the sub-window set before theaspect ratio is changed is obtained on the image having the changedaspect ratio, and an enlarged image is generated by enlarging theobtained partial area. Therefore, a full screen including the imagehaving the changed aspect ratio includes a wrong enlarged image. Adetailed description thereof is now provided with reference to the fullscreen 510 shown in FIG. 5 .

In the existing or general display device, although an aspect ratio of agame image is changed, the positions and sizes of the two sub-windows401 and 402 set in the game image 410 having an aspect ratio of 21:9 andreceived before the aspect ratio is changed are constantly maintained.Referring to FIG. 5 , when an aspect ratio is changed while game contentis being reproduced, an output screen of the display device 100 may beswitched from the full screen 450 to the full screen 510.

After the aspect ratio is changed, an enlarged image 570 included in thefull screen 510 is displayed by enlarging a partial image displayed in apartial area having the same position and size as the previously setsub-window 401. The previously set sub-window 402 does not have aposition and size corresponding to the game image 501 having an aspectratio of 32:9, and is positioned in a black area 571. Therefore, apartial image corresponding to the previously set sub-window 402 is ablack image, and an enlarged image corresponding to the sub-window 402is displayed as a black image 502 on the black area 571.

As described above in relation to FIG. 5 , in the general or existingdisplay device, although an aspect ratio of a received image (e.g., gameimage) is changed while content is being reproduced, the position andsize of a sub-window corresponding to an enlarged image are not changed.As such, the enlarged image provided to a user is displayed as a wrongimage like the enlarged image 570 or 502 described above in relation toFIG. 5 . Specifically, an enlarged image of a wrong image object isdisplayed instead of an enlarged image that the user wants to beprovided with, and thus the user may experience inconvenience during thegame. That is, user convenience and satisfaction may be reduced bydisplaying the wrong enlarged image.

In the following description, full screens output when an aspect ratioof a displayed game image is changed from 32:9 to 21:9 while gamecontent is being reproduced are described in greater detail below withreference to FIGS. 6 and 7 .

FIG. 6 is a diagram illustrating an example full screen including a gameimage output on a display device and having an aspect ratio of 32:9according to various embodiments. In FIG. 6 , the same or similarconfigurations as those of FIG. 5 are denoted by the same referencenumerals, and thus a repeated description thereof may not be providedherein.

Referring to FIG. 6 , when the game image 501 having an aspect ratio of32:9 is received, the display device 100 may display a full screen 650corresponding to the received game image 501.

As described above in relation to FIG. 4 , the game image 501 mayinclude a minimap 601 and an item window 602 as sub-windows.

For example, the full screen 650 may include the game image 501 havingan aspect ratio of 32:9, an enlarged image 670 corresponding to theminimap 601 included as a sub-window in the game image 501, and anenlarged image 680 corresponding to the item window 602 included asanother sub-window in the game image 501. Herein, the enlarged images670 and 680 may be displayed on a black area 660. The black area 660 maybe an area other than an area 610 where the game image 501 is displayedon the full screen 650.

FIG. 7 is a diagram illustrating an example change of a full screenbased on a change of an aspect ratio of a game image from 32:9 to 21:9according to various embodiments. In FIG. 7 , the same or similarconfigurations as those of FIGS. 4 and 6 are denoted by the samereference numerals, and thus a repeated description thereof may not beprovided herein.

Referring to FIG. 7 , after the full screen 650 is displayed, the aspectratio of the game image 501 may be changed from 32:9 to 21:9. Becausethe display device 100 supports output in a plurality of aspect ratios,the display device 100 may receive the game image 410 having the changedaspect ratio of 21:9, decode the received game image 410, and display afull screen 710 corresponding to the decoded game image 410.

In this case, an enlarged image display error may occur equally orsimilarly to that described above in relation to FIG. 5 . The enlargedimage display error is now described in detail with reference to FIG. 7.

In an existing or general display device, although an aspect ratio of agame image is changed, the positions and sizes of the two sub-windows601 and 602 set in the game image 501 having an aspect ratio of 32:9 andreceived before the aspect ratio is changed are constantly maintained.Referring to FIG. 7 , when an aspect ratio is changed while game contentis being reproduced, an output screen of the display device 100 may beswitched from the full screen 650 to the full screen 710.

After the aspect ratio is changed, an enlarged image 770 included in thefull screen 710 is displayed by enlarging a partial image displayed in apartial area having the same position and size as the previously setsub-window 601. The previously set sub-window 602 is not an area whereitems are displayed in the game image 410 having an aspect ratio of21:9, and may be an area where an outer wall of a building is displayedinstead of information meaningful to a game user. Therefore, because apartial image corresponding to the previously set sub-window 602 is animage showing the outer wall of the building, an enlarged image 780corresponding to the sub-window 602 may be displayed as shown in FIG. 7.

As described above in relation to FIG. 7 , in the general or existingdisplay device, although an aspect ratio of a received image (e.g., gameimage) is changed while content is being reproduced, the position andsize of a sub-window corresponding to an enlarged image are not changed.

As such, the enlarged image provided to the user is displayed as a wrongimage like the enlarged image 770 or 780 described above in relation toFIG. 7 . For example, an enlarged image of a wrong image object isdisplayed instead of an enlarged image that the user wants to beprovided with, and thus the user may experience inconvenience during thegame. That is, user convenience and satisfaction may be reduced bydisplaying the wrong enlarged image.

Embodiments of the disclosure relate to a method and apparatus capableof preventing/reducing an enlarged image display error caused when anaspect ratio of an image corresponding to reproduced content is changedas described above in relation to FIGS. 5 and 7 , and a descriptionthereof is now provided in greater detail below with reference to FIGS.8 to 25 .

FIG. 8 is a block diagram illustrating an example configuration of adisplay device according to various embodiments. A display device 800and a source device 801 illustrated in FIG. 8 may correspond to thedisplay device 100 and the source device 101 illustrated in FIG. 1 ,respectively. Therefore, a description repeated from FIGS. 1 to 7 is notprovided herein to describe the display device 800.

Referring to FIG. 8 , the display device 800 includes a display 820, acommunication interface (e.g., including communication circuitry) 830configured to communicate with the source device 801, and a processor(e.g., including processing circuitry) 810 configured to execute atleast one instruction.

The processor 810 included in the display device 800 according to anembodiment of the disclosure may include various processing circuitryand execute the at least one instruction to control one or more elementsincluded in the display device 800 to perform the following operations.For example, the processor 810 receives, from the source device 801, afirst image corresponding to a first aspect ratio, and generates anddisplays a first full screen including the first image and a firstenlarged image corresponding to a first partial area to be enlarged,based on identification of the first partial area in the first image.The processor 810 identifies a second partial area corresponding to thefirst partial area, in a second image corresponding to a second aspectratio different from the first aspect ratio, based on the first andsecond aspect ratios when the second image is received from the sourcedevice 801. The processor 810 generates and displays a second fullscreen including the second image and a second enlarged imagecorresponding to the identified second partial area.

For example, the ‘first image’ may be an image corresponding to contentbeing reproduced on the display device 800. Herein, the content may begame content, lecture content, cinema content, music content, hometraining service content, or other broadcast content (e.g., news, adrama, or a music program). In the following description, a case inwhich the content being reproduced by the display device 800 is gamecontent and the first and second images are game images corresponding toa reproduction screen, a menu screen, an execution screen, or the likeof the game content is shown and described as an example.

A ‘partial area’ may refer to a local area included in an image, and maycorrespond to a ‘sub-window’ described above in relation to FIGS. 4 to 7. For example, in an embodiment of the disclosure, the ‘partial area’(e.g., the ‘first partial area’ or the ‘second partial area’) may referto a local area in a game image, which includes an image object that agame user wants to enlarge.

For example, the partial area included in an image corresponding to thecontent (e.g., the game image) and to be enlarged may be an area whereat least one image object corresponding to at least one of a minimap, atleast one moving object, an item window, a character window, a chatwindow, or a current status information window is displayed. Forexample, the processor 810 may identify, as the first partial area, anarea where at least one of at least one moving object, a minimap, anitem window, a character window, a chat window, or a current statusinformation window included in the first image is displayed, and obtainthe first enlarged image corresponding to the first partial area.

The first and second aspect ratios may have different values. Each ofthe first and second aspect ratios may be the same as or correspond toone of a plurality of aspect ratios supported by the display device 800.

The second image may be output and transmitted from the source device801 based on a user request. For example, the display device 800 maycontrol the source device 801 to transmit the second image having thesecond aspect ratio, based on a user input received while the firstimage having the first aspect ratio is being received from the sourcedevice 801.

The processor 810 executes the at least one instruction to providecontrol to perform an intended operation. Herein, the at least oneinstruction may be stored in an internal memory (not shown) included inthe processor 810, or a memory (not shown) included in the displaydevice 800 separately from the processor 810.

For example, the processor 810 may execute the at least one instructionto control one or more elements included in the display device 800 toperform an intended operation. Therefore, although it is described thatthe processor 810 performs certain operations, it may refer, forexample, to the processor 810 controlling one or more elements includedin the display device 800 to perform the certain operations.

Although the processor 810 is described and illustrated as a singleprocessor, the processor 810 may include a plurality of processors.

For example, the processor 810 may include random access memory (RAM)(not shown) for storing signals or data input from outside the displaydevice 800, or used as a storage space corresponding to variousoperations performed in the display device 800, read-only memory (ROM)(not shown) for storing control programs for controlling the displaydevice 100, applications for providing certain functions or services,and/or a plurality of instructions, and at least one processor (notshown). The processor (not shown) may include a graphics processing unit(GPU) (not shown) for processing graphics corresponding to video. Theprocessor (not shown) may be implemented as a system on chip (SoC) inwhich a core (not shown) and the GPU (not shown) are integrated. Theprocessor 810 may include multiple cores more than a single core. Forexample, the processor 810 may include dual cores, triple cores,quad-cores, hexa-cores, octa-cores, deca-cores, dodeca-cores, orhexadecimal cores.

The display 820 outputs an image on a screen. For example, the display820 may output an image corresponding to video data, through a displaypanel (not shown) included therein, such that a user may visuallyrecognize the video data. Specifically, video data configuring thecontent may include a plurality of frame images, and the display 820 mayreproduce the video content by sequentially displaying the plurality offrame images under the control of the processor 810.

In an embodiment of the disclosure, the display 820 may display, on thescreen under the control of the processor 810, an image corresponding tothe content (e.g., the game image) received from the source device 101.

The communication interface 830 may include various communicationcircuitry and communicate with at least one external device (e.g., thesource device 101) through a wired or wireless communication network.Herein, the external device (not shown) may be the source device 801, aserver device, a storage device, or the like capable of providingcontent.

For example, to communicate with the external device (e.g., the sourcedevice 101) in a wired manner, the communication interface 830 mayinclude at least one port (not shown) to be connected to the externaldevice through a wired cable. For example, the communication interface830 may include at least one of a high-definition multimedia interface(HDMI) port, a component jack, a PC port, or a universal serial bus(USB) port. As such, the communication interface 830 may communicatewith the external device connected through the at least one port (notshown) in a wired manner.

The communication interface 830 may include at least one wirelesscommunication module, wireless communication circuit, or wirelesscommunication device for communicating with the external device, e.g.,the source device 801, in a wireless manner.

For example, the communication interface 830 may include at least onecommunication module (not shown) for performing communication accordingto a communication standard such as Bluetooth, Wi-Fi, BLE, NFC/RFID,Wi-Fi direct, UWB, or Zigbee. The communication interface 830 mayfurther include a server (not shown) for supporting telecommunicationaccording to a telecommunication standard, and a communication module(not shown) for performing communication. For example, the communicationinterface 830 may include a communication module (not shown) forperforming communication through a network for Internet communication.In addition, the communication interface 830 a communication module (notshown) for performing communication through a communication networkaccording to a communication standard such as 3G, 4G, 5G, and/or 6G.

In an embodiment of the disclosure, in order for the display device 800to provide the content transmitted from the source device 801 to theuser, the processor 810 may include an application for providing thereceived content. For example, when the content is the game content, theprocessor 810 may include a game application for controlling and/ormanaging execution of the received game content. For example, the gameapplication may be implemented as at least one instruction or programfor controlling execution of the game content.

In FIGS. 9 to 25 to be referred below, a case in which an image receivedby the display device 800 from the source device 801 is a game imagecorresponding to game content is shown and described as an example. Acase in which the display device 800 includes an HDMI port and isconnected to and communicates with the source device 801 in a wiredmanner through a HMDI cable connected to the HDMI port is described asan example.

The display device 800 may support output of screens having variousresolutions and/or aspect ratios. For example, the display device 800may output, on the display 820 including a display panel having acertain aspect ratio, screens including images having aspect ratios suchas 4:3, 16:9, 16:10, 21:9, and/or 32:9. The size and aspect ratio of thedisplay 820 (specifically, the size and aspect ratio of the displaypanel) may correspond to the size and aspect ratio of a screen outputthrough the display 820. The screen output through the display 820 mayinclude images having various aspect ratios. A physical size or aspectratio of the display 820 may be referred to as a ‘display aspect ratio’or a ‘full screen aspect ratio’, and an aspect ratio of an imagecorresponding to content may be referred to as ‘an aspect ratio of theimage’.

FIG. 9 is a block diagram illustrating an example configuration of adisplay device according to various embodiments. In FIG. 9 , the same orsimilar configurations as those of FIGS. 3 and 8 are denoted by the samereference numerals. A display device 900 and a source device 901illustrated in FIG. 9 may correspond to the display device 100 and thesource device 101 illustrated in FIG. 1 , respectively. The displaydevice 900 and the source device 901 illustrated in FIG. 9 may alsocorrespond to the display device 800 and the source device 801illustrated in FIG. 8 , respectively. Therefore, a description repeatedfrom FIGS. 1 to 8 is not provided herein to describe the display device900.

Initially, the source device 901 is now described. Referring to FIG. 9 ,the source device 901 may include a transmitter 910, an image processor(e.g., including image processing circuitry) 920, and a controller(e.g., including various processing and/or control circuitry) 930.

The transmitter 910 may output an image signal of a resolutionprocessable by the display device 900, and an audio signal of a soundformat processable by the display device 900. For example, the imagesignal may be a digital image signal formed as a digital signal. Thetransmitter 910 may read EDID from the display device 900 under thecontrol of the controller 930. Herein, the EDID may include displaycharacteristic information including information about a resolution, asound format, or the like supported by the display device 900. Forexample, the information about the resolution, which is included in theEDID, may be represented as information about a vertical pixel value anda horizontal pixel value of a screen to be output on the screen of thedisplay device 900. Therefore, the EDID may include information about anaspect ratio supported by the display device 900.

The transmitter 910 may include one or more ports to communicate withthe display device 900. For example, the one or more ports may includeports according to various standards, e.g., a high-definition multimediainterface (HDMI) port, a display port (DP), a Thunderbolt port, a mobilehigh-definition link (MHL) port, and a universal serial bus (USB) port.

The image processor 920 may include various image processing circuitryand process an image to be transmitted through the transmitter 910,under the control of the controller 930.

Similarly to the processor 810, the controller 930 may include variousprocessing and/or control circuitry and executes at least oneinstruction to provide control to perform an intended operation. Forexample, the controller 930 controls overall operation of the sourcedevice 901, and may provide control to process image and audio signalsto be transmitted to the display device 900, and provide control totransmit the processed image and audio signals through the transmitter910 to the display device 900.

The controller 930 may read, from the display device 900, the EDIDincluding the display characteristic information, and control the imageprocessor 920 to process an image, based on the read EDID. The imageprocessing and transmission operation based on the EDID will bedescribed in detail below.

The display device 900 is now described. Referring to FIG. 9 , comparedto the display device 800 illustrated in FIG. 8 , the display device 900may further include at least one of an image processor (e.g., includingimage processing circuitry) 825, an audio processor (e.g., includingaudio processing circuitry) 840, an audio outputter (e.g., includingaudio output circuitry) 850, a storage (e.g., including at least onememory) 861, and/or a user interface (e.g., including user interfacecircuitry) 870.

The communication interface 830 may include various communicationcircuitry and receive the image and audio signals from the source device901 according to a connected protocol and output the image and audiosignals to the image processor 825 and the audio processor 840 under thecontrol of the processor 810.

The communication interface 830 may include at least one of at least onecommunication module or at least one port for transmitting or receivingdata to or from an external device (not shown). Specifically, thecommunication interface 830 may include a communicator 831 and aninputter/outputter 832.

The communicator 831 may include various communication circuitry andcommunicates with the external device through at least one wired orwireless communication network. In an embodiment of the disclosure, thecommunicator 831 may communicate with the source device 901. Forexample, the communicator 831 may be provided in a form including atleast one communication module or communication circuit, and transmit orreceive data to or from the external device through the communicationmodule and/or the communication circuit.

For example, the communicator 831 may include at least one communicationmodule (not shown) for performing communication according to acommunication standard such as Bluetooth, Wi-Fi, BLE, NFC/RFID, Wi-Fidirect, UWB, or Zigbee. The communicator 831 may include a communicationmodule (not shown) for performing communication through a network forInternet communication. The communicator 831 may include a communicationnetwork according to a communication standard such as 3G, 4G, 5G, and/or6G.

The communicator 831 may include a communication module capable ofreceiving a control command from a remote controller (not shown) locatednearby, e.g., an infrared (IR) communication module. In this case, thecommunicator 831 may receive a control command from the remotecontroller (not shown). For example, the control command received fromthe remote controller (not shown) may include a turn on or off commandor a signal for requesting to execute a home training application.

As another example, the control command received from the remotecontroller (not shown) may include a control command related toreproduction of a game. For example, the control command may include acommand for requesting to change an aspect ratio of a game image, or acontrol command based on a user input for setting a sub-window (or anarea to be enlarged) in the game image.

The inputter/outputter 832 may include various input/output circuitryincluding an HDMI port, (not shown), a component jack (not shown), a PCport (not shown), or a USB port (not shown). The inputter/outputter 832may include a combination of an HDMI port, a component jack, a PC port,and a USB port. In this case, the inputter/outputter 832 may receivevideo data to be reproduced on the display device 900, directly throughthe HDMI port, the component jack, the PC port, or the USB port.

The image processor 825 may include various image processing circuitryand process the image signal received from the communication interface830 and output the processed image signal to the display 820 under thecontrol of the processor 810. Herein, the image signal may include videoand/or audio data.

The display 820 may display, on a screen, the image signal received fromthe image processor 825. For example, the display 820 may display animage (e.g., a game image) generated based on the image signal receivedfrom the communication interface 830. As another example, the display820 may display a full screen including a game image generated based onthe image signal received from the communication interface 830, and atleast one enlarged image corresponding to at least one partial areaincluded in the game image.

The audio processor 840 may include various audio processing circuitryand convert the audio signal received from the communication interface830 into an analog audio signal and output the analog audio signal tothe audio outputter 850 under the control of the processor 810.

The audio outputter 850 may include various audio output circuitry andoutput the received analog audio signal through a speaker.

The storage 861 may include at least one memory and store programsrelated to operation of the display device 900, and various types ofdata generated during operation of the display device 900.Alternatively, the storage 861 may store content received from thesource device 901. Alternatively, the storage 861 may store data orinformation required for operation of the display device 900.

The storage 861 may include one or more memories 860, 875, and 880.Herein, the one or more memories 860, 875, and 880 may include at leastone of flash memory, a hard disk, a multimedia card micro, a memory card(e.g., a secure digital (SD) or extreme digital (XD) memory card),random access memory (RAM), static random access memory (SRAM),read-only memory (ROM), electrically erasable programmable read-onlymemory (EEPROM), programmable read-only memory (PROM), magnetic memory,a magnetic disc, or an optical disc.

Although a case in which the storage 861 includes three storage elements860, 875, and 880 is shown as an example in FIG. 9 , the storage 861 mayinclude one, or four or more storage elements. For example, the storage861 may include a memory 860. Alternatively, the storage 861 may includeat least one of a memory 860, an EDID storage 875, or an EDID memory880.

The memory 860 may store programs related to operation of the displaydevice 900, and various types of data generated during operation of thedisplay device 900.

The EDID storage 875 is a memory storing EDID, and may store EDIDincluding a manufacturer/product identifier of the display device 900,an EDID format version, or display characteristic information such as adisplay parameter (e.g., a supported resolution or color format) or anaudio format. The EDID may be stored in the EDID storage 875 by themanufacturer in a production process of the display device 900. Forexample, the EDID storage 875 may use flash memory.

The EDID storage 875 may store EDID corresponding to each of the one ormore ports included in the communication interface 830 of the displaydevice 900. For example, when the communication interface 830 includesan HDMI port and a display port, the EDID storage 875 may store EDIDused for the HDMI port and EDID used for the display port.

For example, the processor 810 may record the EDID stored in the EDIDstorage 875, on the EDID memory 880 such that the EDID may be read bythe source device 901. For example, the EDID memory 880 from which thesource device 901 may read the EDID may be implemented as EEPROM.

For example, the processor 810 may not record the EDID stored in theEDID storage 875, equally on the EDID memory 880, but change the EDID tocorrespond to the content received from the source device 901, andrecord the changed EDID on the EDID memory 880. Herein, when the EDID ischanged, it may refer, for example, to at least some of informationincluded in the EDID being deleted, modified, reset, updated, and/oradded. The EDID stored in a manufacturing process of the display device900 may be referred to as EDID or original EDID in order to bedistinguished from the changed EDID, and the EDID changed by theprocessor 810 may be referred to as changed EDID.

For example, the processor 810 may change the original EDID and storethe changed EDID in the EDID memory 880 whenever necessary to increaseEDID compatibility.

In an embodiment of the disclosure, a plurality of pieces of EDID may bestored in the EDID storage 875 when the display device 900 ismanufactured. For example, the plurality of pieces of EDID stored whenthe display device 900 is manufactured may include original EDIDincluding display characteristic information for implementing optimalperformance of the display device 900, and one or more pieces of changedEDID including display characteristic information changed for EDIDcompatibility. When the plurality of pieces of EDID are stored in theEDID storage 875 as described above, the processor 810 may merely selectsuitable EDID and record the selected EDID on the EDID memory 880without changing the EDID when the display device 900 operates, and thusthe load of the processor 810 may be reduced.

The user interface 870 may include various user interface circuitry andreceive a user input for controlling the display device 900. The userinterface 870 may include a user input device including a touch panelfor sensing touch of a user, buttons for receiving push manipulation ofthe user, a wheel for receiving rotation manipulation of the user, akeyboard, a switch dome, or the like, but is not limited thereto.

The user interface 870 may include a voice recognizer (not shown) forrecognizing voice. For example, the voice recognizer may be amicrophone, and receive a voice command or a voice request of the user.As such, the processor 810 may provide control to perform an operationcorresponding to the voice command or the voice request. Herein, thevoice command or the voice request may be referred to as a ‘voice userinput’.

The user interface 870 may include a motion sensor (not shown). Forexample, the motion sensor (not shown) may detect motion of the displaydevice 900, and receive the detected motion as a user input. The voicerecognizer (not shown) and the motion sensor (not shown) described abovemay not be included in the user interface 870 but be included in thedisplay device 900 as modules independent of the user interface 870.

In the following description, the operation of the display device 900 toreceive the image signal from the source device 901 is described indetail. For example, the processor 810 may process the image and audiosignals transmitted from the source device 901, and provide control todisplay the image signal on the display 820 and output the audio signalthrough the audio outputter 850.

For example, the transmitter 910 of the source device 901 may beconnected to the communication interface 830 (e.g., theinputter/outputter 832) of the display device 900 through one or morecables.

In FIG. 9 , a case in which the transmitter 910 is connected to thecommunication interface 830 through an HDMI cable 990 is shown anddescribed as an example.

In an embodiment of the disclosure, the controller 930 of the sourcedevice 901 may read EDID from the display device 900 when the sourcedevice 901 is connected to the display device 900, control the imageprocessor 920 to process an image signal based on the read EDID, andcontrol the transmitter 910 to transmit the processed image signal tothe display device 900.

Referring to FIG. 9 , the HDMI cable 990 may include atransition-minimized differential signaling (TMDS) line 991 fortransmitting image and audio signals, a display data channel (DDC) line992 for transmitting EDID, a 5V power line 993 for providing a 5Vvoltage from the source device 901 to the display device 900, and a hotplug detect (HPD) line 994 for controlling EDID reading.

When the source device 901 is connected to the display device 900 by theHDMI cable 990, the transmitter 910 of the source device 901 may providea 5V voltage through the 5V power line 993 to the inputter/outputter 832of the display device 900. The inputter/outputter 832 having receivedthe 5V voltage may transmit a signal having a high-level voltage throughthe HPD line 994 to the transmitter 910 of the source device 901. Thetransmitter 910 of the source device 901 having received the signalhaving a high-level voltage through the HPD line 994 may send an EDIDrequest signal through the DDC line 992, and the inputter/outputter 832having received the EDID request signal may provide EDID of the displaydevice 900 to the transmitter 910 of the source device 901 under thecontrol of the processor 810.

The controller 930 of the source device 901 having received the EDID ofthe display device 900 may obtain display characteristic information byparsing the EDID and provide control to process content based on theobtained display characteristic information. For example, the controller930 may provide control to generate an image (e.g., a game image)corresponding to the obtained display characteristic information.Subsequently, the transmitter 910 of the source device 901 may transmitthe processed image and audio signals through the TMDS line 991 to theinputter/outputter 832.

The source device 901 may determine whether the voltage level of the HPDsignal is a high level higher than or equal to a preset certain voltagelevel, and read the EDID from the display device 900 according to theinter-integrated circuit (I2C) bus protocol when the voltage level is ahigh level. Therefore, the display device 900 may control reading of theEDID thereof by the source device 901, by controlling the HPD line 994.Specifically, when the EDID is required to be changed, the displaydevice 900 may prevent and/or reduce the source device 901 from readingthe EDID signal by maintaining the HPD line 994 at a low level while theEDID is being changed, and control the source device 901 to read thechanged EDID by switching the HPD line 994 to a high level after theEDID is completely changed.

For example, the display device 900 may perform the EDID changeoperation when at least one of a resolution or an aspect ratio of theimage received from the source device 901 does not correspond to theEDID of the display device 900. In this case, the display device 900 mayprevent and/or reduce the source device 901 from reading the EDID signalby maintaining the HPD line 994 at a low level while the EDID changeoperation is being performed, and control the source device 901 to readthe changed EDID by switching the HPD line 994 to a high level after theEDID change operation is completely performed.

As described above, the display device 900 may provide the EDID thereofto the source device 901 to receive an image signal including an imagecorresponding to the set EDID. When the aspect ratio and/or theresolution of the image corresponding to the content provided from thesource device 901 is changed, the display device 900 may perform theEDID change operation in response to the change of the aspect ratioand/or the resolution. When an aspect ratio of a game imagecorresponding to game content is changed as described above in relationto FIGS. 5 and 7 , the EDID change operation may be performed asdescribed above.

For example, when the content reproduced by the display device 900 is agame (e.g., a 3D game), the 3D game may use a 360° image to represent a3D space or use a panorama image to represent a 360° space.Specifically, an image corresponding to a partial area corresponding toa FoV of the user on the 360° image 210 may be provided to the user, andthe user may play the 3D game while viewing the provided image. Forexample, the controller 930 of the source device 901 may obtain the EDIDof the display device 900, and control the image processor 920 togenerate an image to be transmitted to the display device 900, based onaspect ratio information included in the obtained EDID (e.g., aspectratio information of 32:9). As such, the image processor 920 may renderan area corresponding to the FoV of the game user in the 360° image 210,based on the aspect ratio of 32:9. As such, the source device 901 mayobtain the image 320 having an aspect ratio of 32:9. The controller 930may control the transmitter 910 to transmit an image signal includingthe obtained image 320 to the inputter/outputter 832 of the displaydevice 900.

FIG. 10 is a signal flow diagram illustrating example operationsperformed in a display device, according to various embodiments. In FIG.10 , the same or similar configurations as those of FIGS. 4 to 9 aredenoted by the same reference numerals. Thus, a description repeatedfrom FIGS. 1 to 9 is not provided herein to describe the operationsshown in FIG. 10 . FIG. 10 is described with reference to the elementsof the display device 900 and the source device 901 illustrated in FIG.9 .

In FIG. 10 , a case in which a full screen aspect ratio of the displaydevice 900 (specifically, a physical aspect ratio of the display 820included in the display device 900) is 16:9 is shown and described as anexample.

The source device 901 may generate an image signal for a first imagecorresponding to a first aspect ratio (S1001), and transmit thegenerated image signal to the display device 900 (S1010). For example,the first aspect ratio may be 21:9. For example, the image signalgenerated in operation S1001 may correspond to the game image 410described above in relation to FIG. 4 .

The display device 900 having received the image signal transmitted inoperation S1010 (for example, the image signal for the first image) mayoutput a first full screen 450 including the first image to the display820, based on the received image signal (S1020).

For example, the display device 900 may identify a first partial area(e.g., 401) to be enlarged, in the first image (S1015), and generate anenlarged image (e.g., 470) corresponding to the identified first partialarea. The display device 900 may generate and display the full screen450 including the enlarged image 470 and the game image 410 having anaspect ratio of 21:9 (S1017).

An aspect ratio of a game image to be output on the display device 900may be changed to a second aspect ratio (S1021). For example, the secondaspect ratio may correspond to an aspect ratio of 32:9. For example, theaspect ratio may be manually changed based on user settings orautomatically changed based on screen optimization of the display device900. As described above in relation to FIG. 9 , the display device 900may reset EDID based on the change of the aspect ratio, and transmit thereset EDID to the source device 901 (S1022).

As such, the source device 901 may generate an image signal for a secondimage having the second aspect ratio (e.g., 32:9) (S1025), and transmitthe generated image signal to the display device 900 (S1026). Forexample, the image signal generated in operation S1025 may correspond tothe game image 501 described above in relation to FIG. 5 .

In an embodiment of the disclosure, when the second image (e.g., 501)corresponding to the second aspect ratio different from the first aspectratio is received from the source device 901, the display device 900 mayidentify a second partial area (e.g., 601) corresponding to the firstpartial area (e.g., 401) included in the first image (e.g., 410), in thesecond image (e.g., 501) based on the first and second aspect ratios(S1040). The display device 900 may generate and display a second fullscreen 650 including the second image (e.g., 501) and a second enlargedimage (e.g., 670) corresponding to the identified second partial area(e.g., 601) (S1050).

When an aspect ratio of an output image is changed while content isbeing reproduced, the display device 900 according to an embodiment ofthe disclosure may identify a partial area to be enlarged (e.g., apartial area corresponding to a partial area set to be enlarged in theimage before the aspect ratio is changed), in the image having thechanged aspect ratio based on the first and second aspect ratios, andgenerate an enlarged image based on the identified partial area. Assuch, the enlarged image display error described above in relation toFIGS. 5 and 7 may be prevented/reduced.

For example, when an aspect ratio of a game image set with a partialarea to be enlarged is changed after the game image is displayed, thedisplay device 900 according to an embodiment of the disclosure mayflexibly change enlargement of the partial area in response to thechange of the aspect ratio. As such, a screen output causing userinconvenience, e.g., enlargement of a wrong area or a reduction inscreen use efficiency, may be prevented/reduced.

Therefore, the display device 900 according to an embodiment of thedisclosure may minimize/reduce inconvenience of a user who is providedwith content, and provide the user with a full screen which is smoothlyswitched based on a change of an aspect ratio.

FIG. 11A is a flowchart illustrating an example method of operating adisplay device, according to various embodiments. For example, anoperating method 1100 of a display device, which is shown in FIG. 11A,may represent operations performed by the display device 100, 800, or900 described above in relation to FIGS. 1 to 10 . In FIG. 11A, the sameor similar operations as those of FIG. 10 are denoted by the samereference numerals. Therefore, a repeated description from theoperations performed by the display device 100, 800, or 900 describedabove in relation to FIGS. 1 to 10 is not provided herein to describethe operations included in the operating method 1100.

In the following description, a case in which the operating method 1100is performed by the display device 900 described above in relation toFIG. 9 is described as an example.

Images received in the operating method 1100 are described withreference to FIG. 12 . In FIG. 12 , the same or similar configurationsas those of FIGS. 4 to 6 are denoted by the same reference numerals.

Full screens output in the operating method 1100 are described withreference to FIG. 13 . In FIG. 13 , the same or similar configurationsas those of FIGS. 4 to 6 are denoted by the same reference numerals.

Referring to FIG. 11A, the method 1100 includes receiving, from thesource device 901, a first image corresponding to a first aspect ratio(S1010). For example, operation S1010 may be performed by thecommunication interface 830 under the control of the processor 810. Forexample, the first image may be received by the inputter/outputter 832through the HDMI cable 990.

For example, the image processor 920 of the source device 901 maygenerate the first image corresponding to the first aspect ratio, andthe transmitter 910 may transmit the first image (or an image signal forthe first image) to the communication interface 830 of the displaydevice 900 under the control of the controller 930. Referring to FIG. 12, the first image received in operation S1010 may be the game image 410having the first aspect ratio (e.g., an aspect ratio of 21:9).

The method 1100 includes generating and displaying a first full screenincluding the first image and a first enlarged image corresponding to afirst partial area to be enlarged, based on identification of the firstpartial area in the first image (S1020). Operation S1020 may beperformed by the display 820 under the control of the processor 810. Forexample, the processor 810 may control the image processor 825 togenerate an image corresponding to the first full screen, and controlthe display 820 to output the generated image in full screen.

Referring to FIG. 13 , the first full screen output in operation S1020may be the full screen 450 described above in relation to FIG. 4 . Inthe example of FIG. 13 , the first partial area set to be enlarged inthe first image may be a partial area corresponding to a sub-window asdescribed above, and include the minimap 401 or the item window 402included in the game image 410. For example, the full screen 450 mayinclude the game image 410 having the first aspect ratio (e.g., anaspect ratio of 21:9) and the first enlarged image (e.g., 470 or 480).The identification of the first partial area will be described ingreater detail below with reference to FIGS. 17 to 19 .

The method 1100 includes receiving, from the source device 901, a secondimage corresponding to a second aspect ratio different from the firstaspect ratio (S1030). For example, operation S1030 may be performed bythe communication interface 830 under the control of the processor 810.For example, the second image may be received by the inputter/outputter832 through the HDMI cable 990.

The second image may be output and transmitted from the source device901 based on a user request. For example, the display device 900 maycontrol the source device 901 to transmit the second image having thesecond aspect ratio, based on a user request received while the firstimage having the first aspect ratio is being received from the sourcedevice 901.

For example, the processor 810 may provide control to receive the secondimage having the changed aspect ratio, e.g., the second aspect ratio,from the source device 901, based on a user input received while thefirst image is being received from the source device 901. For example,the processor 810 may control the communication interface 830 to receivethe second image having the changed aspect ratio, e.g., the secondaspect ratio, from the source device 901, based on a user input receivedwhile the first image is being received from the source device 901.

For example, the processor 810 may receive a user input for requestingto change an aspect ratio (e.g., a user input for requesting to changethe first aspect ratio to the second aspect ratio), through the userinterface 870 while the first image having the first aspect ratio isbeing received from the source device 901. The processor 810 may changeor reset EDID in response to the change of the aspect ratio based on theuser input. The EDID change operation is described in detail above inrelation to FIG. 9 , and thus a detailed description thereof is notprovided herein. Subsequently, the processor 810 may control the sourcedevice 901 to generate the second image having the second aspect ratioand transmit the generated second image to the display device 900, bytransmitting the changed EDID to the source device 901.

For example, the image processor 920 of the source device 901 maygenerate the second image corresponding to the second aspect ratio, andthe transmitter 910 may transmit the second image (or an image signalfor the second image) to the communication interface 830 of the displaydevice 900 under the control of the controller 930. Referring to FIG. 12, the second image received in operation S1030 may be the game image 501having the second aspect ratio (e.g., an aspect ratio of 32:9).

When the second image is received in operation S1030, the method 1100includes identifying a second partial area corresponding to the firstpartial area, in the second image based on the first and second aspectratios (S1040). For example, operation S1040 may be performed by theprocessor 810.

Referring to the example of FIGS. 12 and 13 , when the aspect ratio ofthe displayed image is changed (S1021 (see FIG. 10 )), the second image(e.g., the game image 501 having an aspect ratio of 32:9) may bereceived. The processor 810 may identify the second partial area (e.g.,601 or 602) corresponding to the first partial area (e.g., 401 or 402),in the second image such as the game image 501 based on the first andsecond aspect ratios. When the second partial area (e.g., 601 or 602) isidentified, the enlarged image (e.g., 670 or 680) corresponding to thesecond partial area (e.g., 601 or 602) may be generated. Subsequently,the processor 810 may control the image processor 825 and the display820 to generate and display the full screen 650 including the generatedsecond enlarged image (e.g., 670 or 680).

For example, referring to the example of FIG. 13 , the processor 810 mayidentify the second partial area (e.g., 601 or 602) including the sameimage object as an image object displayed on the first partial area(e.g., 401 or 402) included in the first image (e.g., the game image410), in the second image (e.g., the game image 501) based on the firstand second aspect ratios, and obtain the second enlarged image (e.g.,670 or 680) corresponding to the identified second partial area (e.g.,601 or 602). The processor 810 may control the image processor 825 andthe display 820 to generate and display the full screen 650 in which theobtained second enlarged image (e.g., 670 or 680) is positioned on ablack area.

When the first and second aspect ratios are known, a partial area of thegame image 501 having the second aspect ratio, which corresponds to acertain partial area of the game image 410 having the first aspect ratio(e.g., a partial area where a minimap is displayed) may be extracted.For example, a screen enlargement or reduction ratio set in a horizontaldirection may be present between the first image having the first aspectratio (e.g., the game image 410 having an aspect ratio of 21:9) and thesecond image having the second aspect ratio (e.g., the game image 501having an aspect ratio of 32:9). Therefore, when the first and secondaspect ratios are known, a partial area on the second image having thesecond aspect ratio, which corresponds to a specific partial area on thefirst image having the first aspect ratio may be identified.Accordingly, the processor 810 may identify the second partial area(e.g., 601 or 602) corresponding to the first partial area (e.g., 401 or402) included in the first image such as the game image 410, in thesecond image such as the game image 501 based on the first and secondaspect ratios.

The processor 810 may identify the second partial area (e.g., 601 or602) corresponding to the first partial area (e.g., 401 or 402) in adifferent manner. For example, the processor 810 may identify an imageobject displayed on the first partial area (e.g., 401 or 402), andidentify the same image object as the identified image object(specifically, the image object displayed on the first partial area(e.g., 401 or 402)), in the second image such as the game image 501. Forexample, the processor 810 may identify, as the second partial area(e.g., 601 or 602), an area in the second image such as the game image501, where an image object having a similarity greater than or equal toa threshold value to the image object displayed on the first partialarea (e.g., 401 or 402). Herein, the image object having a similaritygreater than or equal to the threshold value may be detected based onmachine learning. For example, based on machine learning, the game image410 may be compared to the game image 501, and partial areas where thesame image object (e.g., a minimap) is displayed may be extracted fromthe two images.

When the second partial area is identified in operation S1040, themethod 1100 includes generating and displaying a second full screenincluding the second image and a second enlarged image corresponding tothe identified second partial area (S1050). For example, the processor810 may control the image processor 825 to generate an imagecorresponding to the second full screen, and control the display 820 tooutput the generated image in full screen. Referring to FIG. 13 , thesecond full screen output in operation S1050 may be the full screen 650described above in relation to FIG. 6 .

To generate and output the second full screen, the processor 810 mayconsider whether a physical aspect ratio of the display 820 is the sameas or different from the second aspect ratio.

Referring to the example of FIG. 13 , when the physical aspect ratio ofthe display 820 is different from the second aspect ratio, after thesecond image (e.g., 501 of FIG. 13 ) having the second aspect ratio isdisplayed on the second full screen (e.g., 650 of FIG. 13 ), a blackarea may unavoidably occur. Therefore, when the physical aspect ratio ofthe display 820 is different from the second aspect ratio, the enlargedimage 670 or 680 may be displayed on the black area as shown in FIG. 13.

When the physical aspect ratio of the display 820 is the same as thesecond aspect ratio, and when the second image is displayed at themaximum size on the second full screen (e.g., 650 of FIG. 13 ), thesecond full screen is filled with the second image and no black areaoccurs. In this case, to display the enlarged image, the processor 810may split the second full screen into a plurality of screens, anddisplay the second image and the second enlarged image separately in thesplit plurality of areas.

For example, when the aspect ratio of the display 820 is the same as thesecond aspect ratio, the processor 810 may split the full screen of thedisplay 820 into two partial screens, and display the second image inone partial screen and display the second enlarged image in the otherpartial screen.

FIG. 11B is a flowchart illustrating an example method of operating adisplay device, according to various embodiments. In FIG. 11B, the sameor similar configurations as those of FIG. 11A are denoted by the samereference numerals. In FIG. 11B, the same operations as those of FIG. 10are denoted by the same reference numerals.

Referring to FIG. 11B, compared to the operating method 1100 of FIG.11A, an operating method 1101 of a display device may further includeoperation S1021.

Referring to FIGS. 10 and 11B, after the first full screen (e.g., 450)is output in operation S1020, the operating method 1101 may furtherinclude changing an aspect ratio of an image output on the displaydevice 900 (S1021).

For example, the aspect ratio may be changed based on a user input. Thedisplay device 900 may receive, through the user interface 870, a userinput for requesting to change the aspect ratio. For example, when auser input for requesting to change the aspect ratio of the image (e.g.,a game image) corresponding to currently reproduced content from thefirst aspect ratio to a second aspect ratio is received through the userinterface 870, the processor 810 may change the aspect ratio in responseto the reception of the user input. Specifically, as described above inrelation to FIG. 9 , the processor 810 may reset EDID based on thechange of the aspect ratio, and transmit the reset EDID to the sourcedevice 901, thereby providing control to change the aspect ratio.

The aspect ratio change operation based on the user input is describedin greater detail with below reference to FIG. 14 .

FIG. 14 is a diagram illustrating an example of a user interface screendisplayed on a display device, according to various embodiments.

In an embodiment of the disclosure, an aspect ratio may be changed bychanging screen settings or by manually changing the aspect ratio.

For example, when a user input corresponding to screen settings isreceived, the processor 810 may provide control to output a userinterface screen 1400 for screen settings, in response to the receiveduser input.

For example, during a game, a user may want a game image to be output asa wider screen to play the game more realistically and immersively. Forexample, when the user who wants to change an aspect ratio of the gameimage presses a screen settings key of a remote controller (not shown),the processor 810 may provide control to output the user interfacescreen 1400, in response to the received user input.

Then, the user may select an aspect ratio change menu 1430 on the outputuser interface screen 1400, and change the aspect ratio to a desiredscreen ratio (or aspect ratio) in the aspect ratio change menu 1430. Forexample, when the user selects ‘32:9’ in the aspect ratio change menu1430, the processor 810 may change the aspect ratio of the game image to32:9 based on the user input.

In addition, the user interface screen 1400 may further include at leastone of a menu 1420 for determining whether to fix or expand a screendisplay, a menu 1440 for setting a ratio for enlarging or reducing ascreen, a menu 1450 for adjusting a position where an image is output, amenu 1460 for providing guidance or recommendation to set a partial areato be enlarged (hereinafter referred to as a ‘guidance recommendationmenu’), or a menu 1470 for automatically tracing a moving object in agame image (hereinafter referred to as an ‘auto-tracing menu’). Theguidance recommendation menu 1460 will be described below with referenceto FIGS. 17 to 21 . The auto-tracing menu 1470 will be described belowwith reference to FIG. 18 .

FIG. 15 is a diagram illustrating an example of a full screen displayedon a display device, according to various embodiments.

FIG. 16 is a diagram illustrating an example of a full screen displayedon a display device, according to various embodiments.

In FIGS. 15 and 16 , a case in which an aspect ratio of a second imageis different from a physical aspect ratio of the display 820 is shown asan example. The physical aspect ratio of the display 820 refers to aratio of a horizontal length to a vertical length of a display panelprovided as the display 820, and may also be referred to as ‘a displayaspect ratio’.

For example, when the aspect ratio of the display 820 is different froma second aspect ratio, the processor 810 may provide control to displaya second enlarged image on at least a part of a remaining area otherthan an area where the second image is displayed on a full screen of thedisplay 820.

In FIG. 15 , a case in which the aspect ratio of the display 820 is 16:9and the second aspect ratio is 21:9 and in which a partial area to beenlarged is an area 1515 where a minimap is displayed is shown as anexample.

Referring to the example of FIG. 15 , a second full screen 1500 mayinclude an area 1510 where the second image such as a game image 1511 isdisplayed, and a remaining area 1570 other than the area 1510 where thesecond image 1511 is displayed. Herein, the area 1570 where the gameimage 1511 is not displayed on the second full screen 1500 may bereferred to as a ‘remaining area’ for convenience of explanation. InFIG. 15 , a case in which a partial area set to be enlarged in thesecond image 1511 is the area 1515 where the minimap is displayed isshown as an example.

When the aspect ratio of the display 820 is different from the secondaspect ratio indicating an aspect ratio of the second image such as thegame image 1511, as shown in FIG. 15 , the second full screen 1500unavoidably includes the remaining area 1570 where the game image 1511is not displayed. For example, a second enlarged image 1575corresponding to a second partial area 1515 indicating the area 1515where the minimap is displayed may be displayed in the remaining area1570.

For example, the processor 810 may provide control to display the secondenlarged image 1575 on at least a part of the remaining area 1570 otherthan the area 1510 where the second image 1511 is displayed on thesecond full screen 1500.

In an embodiment of the disclosure, when the second partial area 1515 isidentified, the processor 810 may provide control to display the secondfull screen 1500 including the second partial area 1515 and the secondimage 1511. To output the second full screen 1500, the processor 810 maygenerate the second full screen 1500 so as to maximize/increase screenuse efficiency. When the screen use efficiency is maximized/increased,it may refer, for example, to display of a meaningless image (e.g., ablack area) being minimized/reduced and display of a meaningful image ismaximized/increased in a full screen. For example, the ‘meaninglessimage’ may refer to an area other than an area used to provideinformation or content to a user, e.g., a black area. The ‘meaninglessimage’ may refer to an area other than an area provided to the user forartistic and aesthetic purposes.

In an embodiment of the disclosure, to display the second full screen1500 in operation S1050, the processor 810 may adjust at least one ofthe size or position of the second enlarged image 1575 included in thesecond full screen 1500, based on the second aspect ratio and the fullscreen aspect ratio of the display 820.

For example, to display the second enlarged image 1575 in the remainingarea 1570, the processor 810 may adjust the size of the second enlargedimage 1575 so as to maximize/increase the size of the second enlargedimage 1575. As such, the second full screen 1500 may be displayed asshown in FIG. 15 . The position of the second enlarged image 1575included in the remaining area 1570 may be determined based on at leastone of user settings or automatic settings of the processor 810.

For example, the position where the second enlarged image 1575 isdisplayed may be adjusted so as to increase user satisfaction. Forexample, the processor 810 may provide control to display the secondenlarged image 1575 at a position the most easily viewed to the user onthe full screen (e.g., the center of the screen or a positioncorresponding to a FoV of the user).

In FIG. 16 , a case in which the aspect ratio of the display 820 is 16:9and the second aspect ratio is 32:9 and in which a partial area to beenlarged is an area 1615 where a minimap is displayed, as in FIG. 15 ,is shown as an example.

Referring to the example of FIG. 16 , a second full screen 1600 mayinclude an area 1610 where the second image such as a game image 1611 isdisplayed, and a remaining area 1670 other than the area 1610 where thesecond image 1611 is displayed.

For example, to display a second enlarged image 1675 in the remainingarea 1670, the processor 810 may adjust the size of the second enlargedimage 1675 so as to maximize/increase the size of the second enlargedimage 1675. As such, the second full screen 1600 may be displayed asshown in FIG. 16 .

FIG. 17 is a flowchart illustrating an example method of operating adisplay device, according to various embodiments. In FIG. 17 , the sameor similar operations as those of FIG. 10 are denoted by the samereference numerals. In FIG. 17 , the same configurations as those ofFIG. 11A are denoted by the same reference numerals.

In the following description, a case in which an operating method 1700of a display device is performed by the display device 900 describedabove in relation to FIG. 9 is described as an example.

Referring to FIG. 17 , the operating method 1700 may include identifyinga first partial area to be enlarged (e.g., 401) in the first imagereceived in operation S1010 (S1015). Operation S1015 may be performed bythe processor 810. Operation S1015 will be described in detail belowwith reference to FIG. 18 .

The method 1700 may include generating and displaying a first fullscreen including the first image and a first enlarged imagecorresponding to the first partial area identified in operation S1015(S1017).

FIG. 18 is a diagram illustrating an example game image according tovarious embodiments. A first image 1800 shown as the game image in FIG.18 may correspond to the game image 1511 shown in FIG. 15 , and the sameor similar configurations are denoted by the same reference numerals.

Referring to FIG. 18 , the display device 900 may receive the firstimage (e.g., game image) 1800. A case in which the first image 1800 isan image of a battle game played using at least one moving character isshown as an example. In the shown example, the first image 1800 may be areproduction image of the game, and the reproduction image of the gamemay include at least one moving object 1524 or 1525. Herein, the atleast one moving object 1524 or 1525 may represent a charactercorresponding to a user who plays the battle game.

The first image 1800 may include at least one of a minimap 1515, an itemwindow 1523, a character window 1521, a chat window 1522, or a currentstatus information window (not shown).

For example, a first partial area may be manually identified based on auser input. For example, the processor 810 may identify a partial areaincluded in the first image 1800, e.g., the first partial area, based ona user input for selecting the partial area included in the first image1800.

For example, when the first image 1800 is received, the processor 810may control the image processor 825 and the display 820 to output ascreen including the first image 1800. Then, a user may view the firstimage 1800 and input, to the user interface 870, a user input forselecting a partial area of the first image 1800. Then, the processor810 may identify the area selected by the user, as the first partialarea based on the user input. For example, the user may view the gameimage 1800 and input, to the user interface 870, a user input forselecting an area where the minimap 1515 is displayed in the game image1800. Then, the processor 810 may identify the area where the minimap1515 is displayed, as the first partial area based on the user input.

For example, when the first image 1800 is received, the processor 810may output a user interface screen for setting the first partial area inthe first image 1800. The user interface screen includes the first image1800 as a main screen, and may include a guidance message such as ‘Setareas to be enlarged’. Then, the user may input, through the userinterface 870, a user input for selecting an area to be enlarged (e.g.,the area where the minimap 1515 is displayed) in the first image 1800displayed on the user interface screen.

As another example, the first partial area may be automaticallyidentified by the processor 810.

For example, when the first image 1800 is received, the processor 810may identify, as the first partial area, an area where at least one ofthe at least one moving object 1524 or 1525, the minimap 1515, the itemwindow 1523, the character window 1521, the chat window 1522, or thecurrent status information window included in the first image 1800 isdisplayed. For example, the processor 810 may use optical characterrecognition (OCR) or automatic content recognition (ACR) to identify thefirst partial area. For example, the processor 810 may identify the areawhere at least one of the at least one moving object 1524 or 1525, theminimap 1515, the item window 1523, the character window 1521, the chatwindow 1522, or the current status information window included in thefirst image 1800 is displayed, by performing OCR or ACR on the gameimage 1800 corresponding to content.

As another example, when the first image 1800 is received, the processor810 may identify the first partial area using artificial intelligence(AI) technology. For example, the AI technology may be implemented usingalgorithms. Herein, an algorithm or a set of algorithms for implementingthe AI technology is called a neural network. Herein, the neural networkmay receive input data, analyze the input data, and output desiredresultant data. In order to accurately output the resultant datacorresponding to the input data, the neural network needs to be trained.Herein, when the neural network is ‘trained’, it may refer, for example,to various types of data being input to the neural network and theneural network is trained to autonomously find or learn a method ofanalyzing the input data, a method of classifying the input data, and/ora method of extracting, from the input data, feature data required togenerate resultant data.

A set of algorithms for outputting output data corresponding to inputdata through the above-described neural network, software for executingthe set of algorithms, and/or hardware for executing the set ofalgorithms may be referred to as an ‘AI model’.

The AI model may be provided in a wide variety of forms. Specifically, avariety of AI models for receiving an input image, analyzing the inputimage, and classifying an object included in the image, into at leastone class may be present.

The AI model may include at least one neural network, and a case inwhich the AI model includes one neural network 1820 is shown as anexample in FIG. 19 for convenience of explanation.

FIG. 19 is a diagram illustrating an example operation of identifying apartial area included in a game image according to various embodiments.

For example, a method of performing object recognition, object tracking,and/or object discrimination using AI technology for performingcomputation through a neural network is being developed and used. In thefollowing description, for convenience of explanation, operations ofperforming object recognition, object tracking, and objectdiscrimination to recognize a specific image object by analyze an imageare collectively called ‘object recognition’.

For example, the neural network may be a deep neural network (DNN)including a plurality of layers to perform computation at multiplelayers. The DNN computation may include convolutional neural network(CNN) computation. For example, a data recognition model for objectrecognition may be implemented through the shown neural network 1820,and the implemented recognition model may be trained using trainingdata. By analyzing input data, e.g., a received image, using the traineddata recognition model, an object may be recognized in the input imageand the recognized object may be output as output data. The CNN refersto any neural network for performing an algorithm to analyze an imageand find a pattern, and may have various types and forms.

Referring to the example of FIG. 19 , the neural network 1820 may be aneural network trained to receive the first image (e.g., game image)1800 and extract and output an image object displayed on a partial areaincluded in the image 1800 (e.g., a first partial area).

Referring to FIG. 19 , the neural network 1820 may be a neural networktrained to receive the first image 1800 through an input layer 1821,extract a first partial area 1850 included in the input image 1800, andoutput the extracted first partial area 1850 or information about thefirst partial area 1850 to an output end 1825.

For example, the neural network 1820 may be trained to receive aplurality of game images and extract a partial area required to beenlarged, e.g., a first partial area, in the plurality of game images.

For example, the neural network 1820 may receive additional informationabout a game and a game image, and extract the first partial area 1850required to be enlarged in the certain game (e.g., an area where aminimap is display), or an image object included in the first partialarea 1850 (e.g., the minimap). Herein, the ‘additional information’ mayinclude at least one of information about content (e.g., the name of agame or attributes of the game), information about an object required tobe enlarged in the content (e.g., the game), or information about asub-window included in an image of the content (e.g., a game image).Herein, the additional information may be provided from the sourcedevice 901.

For example, the neural network 1820 may be trained based on additionalinformation about a plurality of games to obtain information about apartial area required to be enlarged (e.g., information about the typeof an image object included in the partial area, or the position wherethe image object is displayed) for each of the plurality of games. Forexample, the neural network 1820 may be trained based on game images andadditional information about each of the plurality of games. As such,when a certain game image is input, the trained neural network 1820identify the type of a game corresponding to the certain game image(e.g., game A), and identify or extract a partial area or an imageobject based on the identified type of the game.

For example, a partial area to be enlarged for a user may vary dependingon the type of the game. The neural network 1820 may extract and outputa partial area or an image object to be enlarged in each game, based onthe additional information of the game.

For example, when a game A image is input to the trained neural network1820, the neural network 1820 may extract and output areas where aminimap and an item window are displayed, as partial areas required tobe enlarged in the game A image. When a game B image is input to thetrained neural network 1820, the neural network 1820 may extract andoutput areas where an auto-tracing menu for enlarging a moving object,and a minimap are displayed, as partial areas required to be enlarged inthe game B image.

For example, the above-described neural network 1820 may be implementedin the processor 810. In this case, the processor 810 may input an image(e.g., a game image) to the neural network 1820, and the neural network1820 may select, extract, and output at least one first partial area(specifically, at least one partial area 1850 to be enlarged) byanalyzing the input image.

The neural network 1820 may be implemented in an external server or anexternal device which is separate from the display device 900. In thiscase, the display device 900 may transmit an image (e.g., a game image)corresponding to content to be reproduced, to the neural network (notshown) implemented in the external server or the external device, andreceive, through the communication interface 830, a result output fromthe neural network (not shown) (e.g., a first partial area orinformation about the first partial area). For example, when theabove-described neural network is implemented in an external serverconnected through an Internet network, the display device 900 maytransmit an image (e.g., a game image) through the communicator 831 tothe external server (not shown). Then, the external server (not shown)may input the received image to the neural network, and transmit aresult output from the neural network, to the communicator 831 of thedisplay device 900.

Using the methods described above in relation to FIGS. 18 and 19 , thedisplay device 900 may identify a first partial area (e.g., 401) to beenlarged in the first image (S1015), and generate an enlarged imagecorresponding to the identified first partial area.

FIG. 20 is a diagram illustrating an example of a full screen outputaccording to various embodiments. In FIG. 20 , the same or similarconfigurations as those of FIGS. 15 and 18 are denoted by the samereference numerals. For example, a full screen 2000 shown in FIG. 20 maybe a full screen output on a display device (e.g., 900) according to anembodiment of the disclosure. The full screen 2000 may be a screenoutput in operation S1017 of the operating method 1700 shown in FIG. 17.

Referring to FIGS. 17 and 20 , when the first partial area is identifiedin operation S1015, the operating method 1700 may include generating anddisplaying a first full screen 2000 including the first image 1800 and afirst enlarged image corresponding to the first partial area identifiedin operation S1015 (S1017). For example, the first full screen 2000 mayinclude at least one first enlarged image corresponding to at least onefirst partial area. In FIG. 20 , a case in which the first full screen2000 includes three enlarged images 2010, 2020, and 2030 correspondingto three first partial areas (e.g., 1521, 1524, and 1515 is shown as anexample.

For example, in operation S1015, the processor 810 may identify at leastone partial area included in the first image 1800. For example, theprocessor 810 may identify the character window 1521, the moving object1524, and the minimap 1515 as first partial areas to be enlarged in thefirst image 1800.

The processor 810 may generate at least one first enlarged imagecorresponding to the identified at least one first partial area. Forexample, the processor 810 may control the image processor 825 togenerate the at least one first enlarged image corresponding to theidentified at least one first partial area. Based on the generated atleast one first enlarged image, the first full screen 2000 including thefirst image 1800 and the at least one first enlarged image may begenerated and displayed (S1017). The generation of the enlarged imagewill be described in detail below with reference to FIG. 25 .

FIG. 21 is a flowchart illustrating an example method of operating adisplay device, according to various embodiments. In FIG. 21 , the sameor similar operations as those of FIGS. 10 to 17 are denoted by the samereference numerals.

In the following description, a case in which an operating method 2100of a display device is performed by the display device 900 describedabove in relation to FIG. 9 is described as an example.

In an embodiment of the disclosure, operation S1015 for identifying thefirst partial area may be performed based on a user input. For example,operation S1015 may include displaying a user interface screen fordisplaying guidance areas (S2115), and identifying the first partialarea based on a user input (S2117).

Referring to FIG. 21 , after operation S1010, the operating method 2100may include displaying a user interface screen for displaying one ormore guidance areas on the first image received in operation S1010(S2115). For example, the processor 810 may control the image processor825 and the display 820 to output the user interface screen.

Operation S2115 may be automatically performed based on operation S1010.Alternatively, when the first image is received in operation S1010,operation S2115 may be performed based on a user input for requesting todisplay the user interface screen for displaying the guidance areas.That is, when a user of the display device 900 wants to manually set thefirst partial area to be enlarged in the first image, the user mayinput, to the display device 900, a request or user input for requestingto perform operation S2115.

Herein, the guidance areas may be areas which are used to select an arearequired to be enlarged (e.g., the first partial area), and are definedby guidance lines for displaying partial areas included in the firstimage. The user interface screen output in operation S2115 will bedescribed below with reference to FIGS. 22 and 23 .

For example, the user may view the user interface screen output inoperation S2115, and input, to the display device 900, a user input forselecting at least one of the one or more guidance areas displayed onthe user interface screen. As such, the display device 900 may receive,through the user interface 870, the user input for selecting theguidance area. The processor 810 may identify the first partial areacorresponding to the selected guidance area, based on reception of auser input.

FIG. 22 is a diagram illustrating an example operation of identifying apartial area included in a game image according to various embodiments.

FIG. 23 is diagram illustrating an example operation of identifying apartial area included in a game image according to various embodiments.

In FIGS. 22 and 23 , the same or similar configurations as those ofFIGS. 15 and 18 are denoted by the same reference numerals.

The operating method 2100 may include identifying the first partialarea, based on a user input for selecting a guidance area, which isreceived through the user interface 870 (S2117). For example, operationS2117 may be performed under the control of the processor 810.

Referring to FIGS. 22 and 23 , examples of a user interface screendisplayed on the display device 100, 800, or 900 according to anembodiment of the disclosure are shown. FIGS. 22 and 23 show examples ofthe user interface screen output in operation S2115 described above inrelation to FIG. 21 .

In the following description, a case in which the user interface screensshown in FIGS. 22 and 23 are output on the display device 900 describedabove in relation to FIG. 9 is described as an example.

Referring to FIG. 22 , a user interface screen 2200 output in operationS2115 may be a screen for displaying, on the first image 1800, one ormore guidance areas used to select a certain area.

Referring to the example of FIG. 22 , the one or more guidance areasdisplayed on the first image 1800 may be partitioned and defined by aplurality of guidance lines 2210, 2220, 2230, and 2240. For example,when a user selects a certain point using a tool for selecting one pointon the user interface screen 2200, e.g., a cursor 2201, an area 2205corresponding to the point where the cursor 2201 is positioned may beselected as a guidance area. Herein, the guidance area 2205 may be anarea defined by the guidance lines 2220 and 2240.

In the above-described example, the processor 810 may identify, as thefirst partial area, an area where an image object corresponding to theguidance area 2205 selected based on the user input, e.g., a minimap, isdisplayed. For example, the processor 810 may identify, as the firstpartial area, an area where an image object displayed in the guidancearea 2205 corresponding to the point selected using the cursor 2201 bythe user, e.g., a minimap, is displayed. When the area where the minimapis displayed is identified as the first partial area, the processor 810may provide control to display a full screen (not shown) including thefirst image 1800 and an enlarged image corresponding to the minimap.

As another example, when the user selects one point in a guidance area1523 defined by the guidance lines 2220, 2230, and 2240, using thecursor 2201, the processor 810 may identify, as the first partial area,an area where an image object corresponding to the guidance area 1523selected based on the user input, e.g., the item window 1523, isdisplayed. When the area where the item window 1523 is displayed isidentified as the first partial area, the processor 810 may providecontrol to display a full screen (not shown) including the first image1800 and an enlarged image corresponding to the item window 1523.

Although a case in which a plurality of guidance areas are defined anddisplayed using four guidance lines 2210, 2220, 2230, and 2240 is shownas an example in FIG. 22 , the guidance areas may be displayed on thefirst image 1800 with various positions and sizes in various manners andforms. A plurality of guidance areas may be selected based on a userinput, and a plurality of first partial areas separately correspondingto the selected plurality of guidance areas may be identified. Then, theprocessor 810 may provide control to display a full screen (not shown)including the first image 1800 and a plurality of enlarged imagesseparately corresponding to the identified plurality of first partialareas.

FIG. 23 is a diagram illustrating an example operation of identifying apartial area included in a game image according to various embodiments.

In the example of FIG. 23 , a user interface screen 2301 may be a screenfor displaying one or more guidance areas 2311, 2312, 2313, 2314, 2315,and 2316 on the first image 1800.

For example, the processor 810 may display the user interface screen2301 for displaying the one or more guidance areas 2311, 2312, 2313,2314, 2315, and 2316 on the first image 1800, and identify the firstpartial area, based on a user input for selecting at least one of theone or more guidance areas 2311, 2312, 2313, 2314, 2315, and 2316.

For example, the processor 810 may extract the one or more guidanceareas 2311, 2312, 2313, 2314, 2315, and 2316 included in the first image1800, using the partial area identification or image object recognitionmethod described above in relation to FIG. 19 . The display device 900may display the user interface screen 2301 for displaying the extractedone or more guidance areas 2311, 2312, 2313, 2314, 2315, and 2316 on thefirst image 1800. Then, a user may select at least one of the one ormore guidance areas 2311, 2312, 2313, 2314, 2315, and 2316 displayed onthe first image 1800. The processor 810 may identify, as the firstpartial area, the guidance area 2311, 2312, 2313, 2314, 2315, or 2316selected based on the user input.

For example, when the user selects the guidance area 2315 using a cursor2305, the processor 810 may identify the guidance area 2315 as the firstpartial area based on the user input, and control the image processor825 to generate an enlarged image corresponding to the identified firstpartial area.

FIG. 24 is a diagram illustrating an example of a full screen includinga game image and an enlarged image according to various embodiments. InFIG. 24 , the same or similar configurations as those of FIGS. 15 and 18are denoted by the same reference numerals.

Referring to FIG. 24 , an example of a full screen displayed on thedisplay device 100, 800, or 900 according to an embodiment of thedisclosure is shown. A case in which a full screen 2400 shown in FIG. 24is output on the display device 900 described above in relation to FIG.9 is described as an example.

Referring to FIG. 24 , the full screen 2400 may be a screen output inoperation S1017 shown in FIGS. 10 to 21 . In FIG. 24 , a case in whichthe first partial area identified in operation S2117 is an area wherethe minimap 1515 is displayed is shown as an example.

In an embodiment of the disclosure, to display the first full screen inoperation S1017, the processor 810 may adjust at least one of the sizeor position of the first enlarged image included in the first fullscreen, based on the first aspect ratio and a full screen aspect ratioof the display 820.

For example, the full screen 2400 may be a screen including the firstimage 1800 and a first enlarged image 2410 corresponding to the firstpartial area identified in operation S2117 (e.g., an area where theminimap 1515 is displayed). For example, the processor 810 may generatethe first full screen so as to maximize/increase screen use efficiency.Herein, when the screen use efficiency is maximized/increased, it mayrefer, for example, to display of a meaningless image (e.g., a blackarea 2401) being minimized/reduced and display of a meaningful image ismaximized/increased in a full screen.

FIG. 25 is a flowchart illustrating an example method of operating adisplay device, according to various embodiments. In FIG. 25 , the sameor similar operations as those of FIGS. 10 to 21 are denoted by the samereference numerals.

In the following description, a case in which a method 2500 of operatinga display device is performed by the display device 900 described abovein relation to FIG. 9 is described as an example.

Referring to FIG. 25 , after operation S1015, the operating method 2500may further include obtaining a first enlarged image corresponding tothe first partial area (S1016). The first enlarged image may be obtainedusing the following methods.

For example, in operation S1016, the display device 900 may request thesource device 901 to transmit image data corresponding to the firstpartial area identified in S1015, and the source device 901 may transmitthe image data corresponding to the first partial area to the displaydevice 900 in response to the request. Herein, the image datatransmitted from the source device 901 may be original image data of thefirst partial area. Then, the image processor 825 may generate the firstenlarged image based on the received image data.

As another example, in operation S1016, the first partial areaidentified in operation S1015 is cut out from the first image receivedin operation S1010, and an enlarged image may be generated by enlargingthe cut first partial area. That is, the image processor 825 maygenerate the enlarged image by cutting out the identified first partialarea from the first image received in operation S1010.

A second enlarged image corresponding to the second partial areaidentified in operation S1040 may be obtained in the same manner as theabove-described method of obtaining the first enlarged image. Forexample, the display device 900 may request the source device 901 totransmit image data corresponding to the identified second partial area,and the source device 901 may transmit the image data corresponding tothe second partial area to the display device 900 in response to therequest. Herein, the image data transmitted from the source device 901may be original image data of the second partial area. Then, the imageprocessor 825 may generate the second enlarged image based on thereceived image data. As another example, the display device 900 may cutout the second partial area identified in operation S1040 from thesecond image received in operation S1030, and an enlarged image may begenerated by enlarging the cut second partial area. That is, the imageprocessor 825 may generate the enlarged image by cutting out theidentified second partial area from the second image received inoperation S1030.

A method of operating a display device, according to an embodiment ofthe disclosure, may be implemented in the form of program commands thatcan be executed through various computer means, and be recorded on acomputer-readable medium. An embodiment of the disclosure may beimplemented in the form of a computer-readable recording medium havingrecorded thereon one or more programs including instructions forexecuting the operating method of the display device.

The computer-readable medium may include program commands, data files,data structures, or combinations thereof. The program commands recordedon the medium may be those specially designed and constructed for thepurposes of the disclosure, or they may be of the kind well known andavailable to one of ordinary skill in the art of computer software.Examples of the computer-readable recording medium include magneticmedia (e.g., hard disks, floppy disks, and magnetic tape), optical media(e.g., CD-ROMs or DVDs), magneto-optical media (e.g., floptical disks),and hardware devices (e.g., ROMs, RAMs, or flash memories, etc.) thatare specially configured to store and execute program commands. Examplesof the program commands include both machine code, such as produced by acompiler, and high-level language code that may be executed by thecomputer using an interpreter.

A machine-readable storage medium may be provided in the form of anon-transitory storage medium. When the storage medium is‘non-transitory’, the storage medium is tangible and does not includesignals (e.g., electromagnetic waves), and it does not limit that datais semi-permanently or temporarily stored in the storage medium. Forexample, the ‘non-transitory storage medium’ may include a bufferstoring data temporarily.

According to an embodiment of the disclosure, the method according tovarious embodiments of the disclosure may be included and provided in acomputer program product. The computer program product may be traded asa commercial product between sellers and purchasers. The computerprogram product may be distributed in the form of a machine-readablestorage medium (e.g., a compact disc read only memory (CD-ROM)), or beelectronically distributed (e.g., downloaded or uploaded) via anapplication store (e.g., Play Store™) or directly between two userdevices (e.g., smartphones). For electronic distribution, at least apart of the computer program product (e.g., a downloadable app) may betemporarily generated or be at least temporarily stored in amachine-readable storage medium, e.g., a memory of a server of amanufacturer, a server of an application store, or a relay server.

While the disclosure has been illustrated and described with referenceto various example embodiments, it will be understood that the variousexample embodiments are intended to be illustrative, not limiting. Itwill be further understood by those skilled in the art that variouschanges in form and detail may be made without departing from the truespirit and full scope of the disclosure, including the appended claimsand their equivalents. It will also be understood that any of theembodiment(s) described herein may be used in conjunction with any otherembodiment(s) described herein.

What is claimed is:
 1. A display device comprising: a display; acommunication interface comprising communication circuitry configured tocommunicate with a source device; and a processor configured to executeat least one instruction to: receive, from the source device, a firstimage corresponding to a first aspect ratio; based on a first partialarea being identified in the first image, control the display to displaya first full screen comprising the first image and a first enlargedimage corresponding to the first partial area; based on a second imagecorresponding to a second aspect ratio different from the first aspectratio being received from the source device, identify, in the secondimage, a second partial area corresponding to the first partial area,based on the first and second aspect ratios; and control the display todisplay a second full screen comprising the second image and a secondenlarged image corresponding to the identified second partial area. 2.The display device of claim 1, wherein the processor is furtherconfigured to execute the at least one instruction to: identify, in thesecond image, the second partial area comprising the same image objectas an image object included in the first partial area in the firstimage, based on the first and second aspect ratios; and obtain thesecond enlarged image corresponding to the identified second partialarea.
 3. The display device of claim 1, wherein the processor is furtherconfigured to execute the at least one instruction to: control thecommunication interface to receive the second image having the secondaspect ratio from the source device, based on an input received whilethe first image is being received from the source device.
 4. The displaydevice of claim 1, wherein the processor is further configured toexecute the at least one instruction to: identify, as the first partialarea, an area including at least one of a moving object, a minimap, anitem window, a character window, a chat window, or a current statusinformation window, in the first image; and obtain the first enlargedimage corresponding to the first partial area.
 5. The display device ofclaim 1, wherein the processor is further configured to execute the atleast one instruction to identify the first partial area, based on aninput for selecting a partial area in the first image.
 6. The displaydevice of claim 1, further comprising a user interface configured toreceive an input, wherein the processor is further configured to executethe at least one instruction to: control the display to display a userinterface screen displaying one or more guidance areas on the firstimage; and identify the first partial area, based on an input forselecting at least one of the one or more guidance areas.
 7. The displaydevice of claim 1, wherein the processor is further configured toexecute the at least one instruction to: recognize one or more imageobjects corresponding to one or more of a minimap, a moving object, anitem window, a character window, a chat window, and a current statusinformation window in the first image; display a user interface screenfor selecting at least one of the recognized one or more image objects;and identify the first partial area, based on an input for selecting atleast one of the one or more image objects.
 8. The display device ofclaim 1, wherein the processor is further configured to execute the atleast one instruction to: based on an aspect ratio of the display beingsame as the second aspect ratio, split a full screen of the display intotwo partial screens, and control the display to display the second imagein one partial screen and display the second enlarged image in the otherpartial screen.
 9. The display device of claim 1, wherein the processoris further configured to execute the at least one instruction to: basedon an aspect ratio of the display being different from the second aspectratio, control the display to display the second enlarged image on atleast a part of a remaining area other than an area where the secondimage is displayed on a full screen of the display.
 10. The displaydevice of claim 9, wherein the processor is further configured toexecute the at least one instruction to: adjust a size the secondenlarged image to increase screen use efficiency of the remaining area;and display the size-adjusted second enlarged image on the remainingarea.
 11. The display device of claim 1, wherein the processor isfurther configured to execute the at least one instruction to: adjust atleast one of a size or a position of the second enlarged image includedin the second full screen, based on the second aspect ratio and a fullscreen aspect ratio of the display.
 12. The display device of claim 1,wherein the first image comprises an image corresponding to game contentcorresponding to the first aspect ratio, and wherein the second imagecomprises an image corresponding to game content corresponding to thesecond aspect ratio.
 13. The display device of claim 1, wherein theprocessor is further configured to execute the at least one instructionto: identify, as the first partial area, an area including a minimap inthe first image corresponding to a reproduction image of game content;generate a first enlarged image corresponding to the first partial area;and control the display to display the first full screen comprising thefirst enlarged image and the first image.
 14. A method of operating adisplay device, the method comprising: receiving, from a source device,a first image corresponding to a first aspect ratio; based on a firstpartial area being identified in the first image, displaying a firstfull screen comprising the first image and a first enlarged imagecorresponding to the first partial area; receiving, from the sourcedevice, a second image corresponding to a second aspect ratio differentfrom the first aspect ratio; identifying, in the second image, a secondpartial area corresponding to the first partial area based on the firstand second aspect ratios; and displaying a second full screen comprisingthe second image and a second enlarged image corresponding to theidentified second partial area.
 15. The method of claim 14, wherein theidentifying of the second partial area comprises: identifying, in thesecond image, the second partial area comprising the same image objectas an image object included in the first partial area in the firstimage, based on the first and second aspect ratios; and obtaining thesecond enlarged image corresponding to the identified second partialarea.
 16. The method of claim 14, wherein the displaying of the firstfull screen comprises: identifying, as the first partial area, an areawhere at least one of a moving object, a minimap, an item window, acharacter window, a chat window, or a current status information window,in the first image; and obtaining the first enlarged image correspondingto the first partial area.
 17. The method of claim 14, furthercomprising: displaying a user interface screen for displaying one ormore guidance areas on the first image; and identifying the firstpartial area, based on an input for selecting at least one of the one ormore guidance areas.
 18. The method of claim 14, further comprising:recognizing one or more image objects corresponding to one or more of aminimap, a moving object, an item window, a character window, a chatwindow, and a current status information window in the first image;displaying a user interface screen for selecting at least one of therecognized one or more image objects; and identifying the first partialarea, based on an input for selecting at least one of the one or moreimage objects.
 19. The method of claim 14, wherein the displaying of thesecond full screen comprises: based on an aspect ratio of the displaybeing different from the second aspect ratio, displaying the secondenlarged image on at least a part of a remaining area other than an areawhere the second image is displayed on a full screen of a display in thedisplay device.
 20. The method of claim 14, wherein the displaying ofthe second full screen further comprises: adjusting at least one of asize or a position of the second enlarged image included in the secondfull screen, based on the second aspect ratio and a full screen aspectratio of a display in the display device.